Author

  • Lenandlar Singh

    • Department of Computer Science, University of Guyana
    • Guyana

Abstract

Surveys have long become a standard data collection tool. In more recent times web surveys have become particularly popular given their cost-effectiveness on one hand, and the ubiquitous nature of the internet and the World Wide Web on the other. Regardless of the type of survey, a number of issues still challenge survey researchers and practitioners. The accuracy of data collected for socio-demographic and other factual –type research questions is of utmost importance if the researcher is to make any claim about the data collected. Accuracy as characteristic of data quality is perhaps the most important issue of all. This paper specifically reviews the body of literature on work completed on data quality and identifies and analyzes studies on accuracy and reliability of data. This paper critically examines the most significant published research in the literature that addresses the issue of accuracy and reliability of survey data. Specifically, this review addresses and critique existing research methods, identifies and discusses important limitations, and concludes with a discourse on key questions to be answered and suggestions for future research.

Keywords

References

  • Ajzen, I. (1985). From intentions to actions: A theory of planned behavior. In J. Kuhl & J. Beckman (Eds.), Action-control: From cognition to behavior (11–39). Heidelberg: Springer.
  • Ajzen, I. (1991). The Theory of Planned Behavior. Organizational Behavior and Human Decision Processes , 50 , 179-211.
  • Blau, P. (1964). Exchange and Power. New York: John Wiley and Sons.
  • Bosnjak, M., & Tuten, T. L. (2003). Prepaid and Promised Incentives in Web Surveys: An Experiment. Social Science Computer Review, 21(2), 208-217.
  • Bosnjak, M., Tuten, T. L., & Wittmann, W. W. (2005). Unit (Non) Response in Web-Based Access Panel Surveys: An Extended Planned-Behavior Approach. Psychology & Marketing , 22(6), 489–505.
  • Cahalan, D. (1968). Correlates of respondent inaccuracy in the Denver validity survey. Public Opinion Quarterly , 32, 607-21.
  • Chang, L. & Krosnick, J. A. (2009). National Surveys via RDD Telephone Interviewing Versus the Internet: Comparing Sample Representativeness and Response Quality. Public Opinion Quarterly , 73(4), 641–678.
  • Cobanoglu, C., Warde, B., & Moreo, P. J. (2001). A comparison of mail, fax and web survey methods. International Journal of Market Research , 43(4), 441–452.
  • Couper, M. P. (2000). Web Surveys. A Review of Issues and Approaches. Public Opinion Quarterly 64(4), 464–94.
  • Crisanti, A., Laygo, R., & Junginger, J. (2003). A review of the validity of self-reported arrests among persons with mental illness. Current Opinion in Psychiatry , 16, 565–569.
  • Dillman, D. A. (2000). Mail and Internet Surveys: The Tailored Design Method . New York: Wiley.
  • Dillman, D. A., Gertseva, A., & Mahon-Haft, T. (2005). Achieving Usability in Establishment Surveys through the Application of Visual Design Principles. Journal of Official Statistics , 21(2), 183–214.
  • Elo, K. (2009). Asking Factual Knowledge Questions: Reliability in Web-Based, Passive Sampling Surveys. Social Science Computer Review , 0(0), 1-16.
  • Galesic, M., Tourangeau, R. & Couper, M. P. (2006). Complementing Random-Digit-Dial Telephone Surveys with other Approaches to Collecting Sensitive Data. American Journal of Preventive Medicine , 31(5), 437–443.
  • Ganassali, S. (2008). The Influence of the Design of Web Survey Questionnaires on the Quality of Responses. Survey Research Methods , 2(1), 21-32.
  • Gendall, P., & Healey, B. (2008). Asking the age questions in mail and online surveys. International Journal of Market Research , 50(3), 309-317.
  • Gibson, R., & McAllister, I. (2002). The future of national election surveys? Paper presented at the 98th Annual Meeting of the American Political Science Association (APSA). Evaluating online election surveys in Australia, Boston, M A.
  • Heerwegh, D. (2002.). Describing response behavior in web surveys using client-side paradata. Paper presented at the International Workshop on Web Surveys, Mannheim, Germany.
  • Heerwegh, D., & Loosveldt, G. (2002). Web Surveys: The effects of Controlling Survey Access Using PIN Numbers. Social Science Computer Review , 20(1), 10-21.
  • Heerwegh, D. (2005). Effects of Personal Salutations in Email Invitations to Participate in a Web Survey. Public Opinion Quarterly , 73(4), 641–678.
  • Heerwegh, D., Vanhove, T., Matthijs, K. & Loosveldt, G. (2005). The Effect of Personalization on Response Rates and Data Quality in Web Surveys. International Journal of Social Research Methodology , 8(2), 85-99.
  • Heerwegh, D. (2006). An Investigation of the Effect of Lotteries on Web Survey Response Rates. Field Methods , 18(2), 205–220.
  • Heerwegh, D., & Loosveldt, G. (2006). An Experimental Study on the Effects of Personalization, Survey Length Statements, Progress Indicators, and Survey Sponsor Logos in Web Surveys. Journal of Official Statistics , 22(2), 191–210.
  • Heerwegh, D., & Loosveldt, G. (2008). Face-To-Face Versus Web Surveying in a High- Internet-Coverage Population: Differences in Response Quality. Public Opinion Quarterly , 72(5), 836-846.
  • Heerwegh, D. (2009). Mode Differences Between Face-to-Face and Web Surveys: An Experimental Investigation of Data Quality and Social Desirability Effects. International Journal of Public Opinion Research, 21(1), 111-121.
  • Hyman, H. (1944). Do They Tell The Truth? Public Opinion Quarterly, 8(4), 557-559.
  • Knapp, H., & Kirk, S. A. (2003). Using pencil and paper, Internet and touch-tone phones for selfadministered surveys: does methodology matter? Computers in Human Behavior , 19(1), 117–134.
  • Krosnick, J. A. (1991). Response Strategies for Coping with the Cognitive Demands of Attitude Measures in Surveys. Applied Cognitive Psychology, 5, 213–36.
  • Kwak, N. & Radler, B. (2002). A Comparison between Mail and Web Surveys: Response Pattern, Respondent Profile, and Data Quality . Journal of Official Statistics , 18(2), 257-273.
  • Leggett, C. G., Kleckner, N. S., Boyle, K J., Duffield, J .W. & Mitchell, R. C.(2003). Social desirability bias in contingent valuation surveys administration through in-person interviews. Land Economics , 79 (4), 561–575.
  • Manfreda, K. L., Batagelj, Z., & Vehovar, V. (2002). Design of Web survey questionnaires: Three basic experiments. Journal of Computer-Mediated Communication, 7(3). Retrieved January 5, 2010 from http://jcmc.indiana.edu/vol7/issue3/vehovar.html.
  • Miller, P. V., & Groves, R. M. (1985). Matching Survey Responses to Official Records: An Exploration of Validity in Victimization Reporting. Public Opinion Quarterly , 49(3), 366-380.
  • Newman, J. C., Des Jarlais, D. C., Paone, D., Turner, C. F., Gribble, J., & Cooley, P. (2002). The differential effects of face-to-face and computer interview modes. American Journal of Public Health, 92, 294– 297.
  • Nunnally, J. (1978). Psychometric Theory. New York: McGraw-Hill.
  • Peterson, R. A. (1984) Asking the age question: a research note. Public Opinion Quarterly , 48(1), 379–383.
  • Presser, S. (1984). Is Inaccuracy on Factual Survey Items Item-Specific or Respondent-Specific? Public Opinion Quarterly , 48(1), 344-355.
  • Sanders, D., Clarke, H. D., Stewart, M. C., & Whiteley, P. (2007). Does mode matter for modeling political choice? Evidence from the 2005 British Election Study. Political Analysis , 15, 257-285.
  • Smith, J. H., Deeg, D. J. H. & Schmand, B. A. (1997) Asking the age question in elderly populations: a reverse record check study. Journals of Gerontology Series B: Psychological Sciences and Social Sciences , 52(4), 175–177.
  • Tourangeau, R., Rips, L. J., & Rasinski, K. A. (2000). The Psychology of Survey Response . Cambridge: Cambridge University Press.
  • Warriner, G. K. (1991). Accuracy of self-reports to the burdensome question: survey response and non response error trade-offs. Quality & Quantity , 25, 253-269.
  • Yeager, D. S., Krosnick, J. A., Chang, L., Javitz, H. S., Levindusky, M. A., Simpser,A., & Wang, R. (2009). Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and Non-Probability Samples. Knowledge Networks. Retrieved January 2, 2010, from http://www.knowledgenetworks.com/insights/docs/Mode-04_2.pdf

Downloads

No downloads have been recorded for this article yet. Figures appear here once readers begin downloading the full text.

How to Cite

Singh, L. (2011). Accuracy of Web Survey Data: The State Of Research on Factual Questions in Surveys. Information Management and Business Review, 3(2), 48-56. https://doi.org/10.22610/imbr.v3i2.916

Share this article

License

Copyright (c) 2011 Lenandlar Singh (Author)

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Author (s) should affirm that the material has not been published previously. It has not been submitted and it is not under consideration by any other journal. At the same time author (s) need to execute a publication permission agreement to assume the responsibility of the submitted content and any omissions and errors therein. After submission of revised paper in the light of suggestions of the reviewers, the editorial team  edits and formats manuscripts to bring uniformity and standardization in published material.

This work will be licensed under Creative Commons Attribution 4.0 International (CC BY 4.0) and under condition of the license, users are free to read, copy, remix, transform, redistribute, download, print, search or link to the full texts of articles and even build upon their work as long as they credit the author for the original work. Moreover, as per journal policy author (s) hold and retain copyrights without any restrictions.

Keywords

Section

Research Paper

Published in

Vol. 3 No. 2 (2011) Human Capital, Economic Growth & Foreign Investment View issue contents

Published

2011-08-15

Submissions

Have research to publish? Information Management and Business Review welcomes submissions.

Make a Submission