Assessing Within-Household Selection Methods in Household Mail Surveys
Kristen M. Olson, Mathew Stange, Jolene D. Smyth
Abstract
Kristen M. Olson, Mathew Stange, Jolene D. Smyth
Abstract
Household surveys are increasingly moving toward self-administered modes of data collection. To maintain a probability sample of the population, researchers must use probability methods to select adults within households. However, very little experimental methodological work has been conducted on within-household selection in mail surveys. In this study, we experimentally examine four methods—the next-birthday method, the last-birthday method, selection of the youngest adult in the household, and selection of the oldest adult in the household—in two mail surveys of Nebraska residents (n = 2,498, AAPOR RR1 36.3 percent, and n = 947, AAPOR RR1 31.6 percent). To evaluate how accurately respondents were selected from among all adults in the household, we also included a household roster in the questionnaire for one of the surveys. We evaluated response rates, the completed sample composition resulting from the different within-household selection methods, and the accuracy of within-household selection. The analyses indicate that key demographics differed little across the selection methods, and that all of the within-household selection methods tend to underrepresent key demographic groups such as Hispanics and persons with lower levels of education. Rates of selection accuracy were low among the four selection methods analyzed, and the rates were similar across all four methods.
OpenAlex reports 28 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
Household surveys are increasingly moving toward self-administered modes of data collection. To maintain a probability sample of the population, researchers must use probability methods to select adults within households. However, very little experimental methodological work has been conducted on within-household selection in mail surveys. In this study, we experimentally examine four methods—the next-birthday method, the last-birthday method, selection of the youngest adult in the household, and selection of the oldest adult in the household—in two mail surveys of Nebraska residents (n = 2,498, AAPOR RR1 36.3 percent, and n = 947, AAPOR RR1 31.6 percent). To evaluate how accurately respondents were selected from among all adults in the household, we also included a household roster in the questionnaire for one of the surveys. We evaluated response rates, the completed sample composition resulting from the different within-household selection methods, and the accuracy of within-household selection. The analyses indicate that key demographics differed little across the selection methods, and that all of the within-household selection methods tend to underrepresent key demographic groups such as Hispanics and persons with lower levels of education. Rates of selection accuracy were low among the four selection methods analyzed, and the rates were similar across all four methods.
Key concepts: Selection (genetic algorithm), Demographics, Selection bias, Sample (material), Demography, Data collection, Geography, Statistics