2012Choice Reviews OnlineRequires access

The problem with survey research

Author information unavailable

Open publisher page 26 citations

Abstract

The Problem with Survey Research makes a case against survey research as a primary source of reliable information. George Beam argues that all survey research instruments, all types of asking--including polls, face-to-face interviews, and focus groups--produce unreliable and potentially inaccurate results. Because those who rely on survey research only see answers to questions, it is impossible for them, or anyone else, to evaluate the results. They cannot know if the answers correspond to respondents' actual behaviors (objective phenomena) or to their true beliefs and opinions (subjective phenomena). Reliable information can only be acquired by observation, experimentation, multiple sources of data, formal model building and testing, document analysis, and comparison. In fifteen chapters divided into six parts--Ubiquity of Survey Research, The Problem, Asking Instruments, Asking Settings, Askers, and Proper Methods and Research Designs--The Problem with Survey Research demonstrates how asking instruments, settings in which asking and answering take place, and survey researchers themselves skew results and thereby make answers unreliable. The last two chapters and appendices examine observation, other methods of data collection and research designs that may produce accurate or correct information, and shows how reliance on survey research can be overcome, and must be.

About this research paper

What this paper is about

The Problem with Survey Research makes a case against survey research as a primary source of reliable information. George Beam argues that all survey research instruments, all types of asking--including polls, face-to-face interviews, and focus groups--produce unreliable and potentially inaccurate results. Because those who rely on survey research only see answers to questions, it is impossible for them, or anyone else, to evaluate the results. They cannot know if the answers correspond to respondents' actual behaviors (objective phenomena) or to their true beliefs and opinions (subjective phenomena). Reliable information can only be acquired by observation, experimentation, multiple sources of data, formal model building and testing, document analysis, and comparison. In fifteen chapters divided into six parts--Ubiquity of Survey Research, The Problem, Asking Instruments, Asking Settings, Askers, and Proper Methods and Research Designs--The Problem with Survey Research demonstrates how asking instruments, settings in which asking and answering take place, and survey researchers themselves skew results and thereby make answers unreliable. The last two chapters and appendices examine observation, other methods of data collection and research designs that may produce accurate or correct information, and shows how reliance on survey research can be overcome, and must be.

Why it matters

OpenAlex reports 26 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

The Problem with Survey Research makes a case against survey research as a primary source of reliable information. George Beam argues that all survey research instruments, all types of asking--including polls, face-to-face interviews, and focus groups--produce unreliable and potentially inaccurate results. Because those who rely on survey research only see answers to questions, it is impossible for them, or anyone else, to evaluate the results. They cannot know if the answers correspond to respondents' actual behaviors (objective phenomena) or to their true beliefs and opinions (subjective phenomena). Reliable information can only be acquired by observation, experimentation, multiple sources of data, formal model building and testing, document analysis, and comparison. In fifteen chapters divided into six parts--Ubiquity of Survey Research, The Problem, Asking Instruments, Asking Settings, Askers, and Proper Methods and Research Designs--The Problem with Survey Research demonstrates how asking instruments, settings in which asking and answering take place, and survey researchers themselves skew results and thereby make answers unreliable. The last two chapters and appendices examine observation, other methods of data collection and research designs that may produce accurate or correct information, and shows how reliance on survey research can be overcome, and must be.

Key concepts: Survey research, Computer science, Data collection, Survey data collection, Data science, Survey methodology, Psychology, Sociology

Related papers

Back to paper searchBrowse research topicsOriginal source
The problem with survey research — Research Paper | ScholarLens