Sociology, Department of
Date of this Version
2017
Citation
Published in Public Opinion Quarterly 81:3 (Fall 2017), pp 688–713.
doi 10.1093/poq/nfx025
Abstract
Randomly selecting a single adult within a household is one of the biggest challenges facing mail surveys. Yet obtaining a probability sample of adults within households is critical to having a probability sample of the US adult population. In this paper, we experimentally test three alternative placements of the within-household selection instructions in the National Health, Wellbeing, and Perspectives study (sample n = 6,000; respondent n = 998): (1) a standard cover letter informing the household to ask the person with the next birthday to complete the survey (control); (2) the control cover letter plus an instruction on the front cover of the questionnaire itself to have the adult with the next birthday complete the survey; and (3) the control cover letter plus an explicit yes/ no question asking whether the individual is the adult in the household who will have the next birthday. Although the version with an explicit question had a two-point decrease in response rates relative to not having any instruction, the explicit question significantly improves selection accuracy relative to the other two designs, yields a sample composition closer to national benchmarks, and does not affect item nonresponse rates. Accurately selected respondents also differ from inaccurately selected respondents on questions related to household tasks. Survey practitioners are encouraged to use active tasks such as explicit questions rather than passive tasks such as embedded instructions as part of the within-household selection process.
Supplementary data (spreadsheet) is attached below.
Included in
Family, Life Course, and Society Commons, Quantitative, Qualitative, Comparative, and Historical Methodologies Commons, Social Psychology and Interaction Commons, Social Statistics Commons
Comments
Copyright © 2017 Kristen Olson and Jolene D. Smyth . Published by Oxford University Press on behalf of the American Association for Public Opinion Research. Used by permission.