Sociology, Department of
Date of this Version
March 2006
Abstract
A common hypothesis about practices to reduce survey nonresponse is that those persons brought into the respondent pool through persuasive efforts may provide data filled with measurement error. Two questions flow from this hypothesis. First, does the mean square error of a statistic increase when sample persons who are less likely to be contacted or cooperate are incorporated into the respondent pool? Second, do nonresponse bias estimates made on the respondents, using survey reports instead of records, provide accurate information about nonresponse bias? Using a unique data set, the Wisconsin Divorce Study, with divorce records as the frame and questions about the frame information included in the questionnaire, this article takes a first look into these two issues. We find that the relationship between nonresponse bias, measurement error bias, and response propensity is statistic- specific and specific to the type of nonresponse. Total bias tends to be lower on estimates calculated using all respondents, compared with those with only the highest contact and cooperation propensities, and nonresponse bias analyses based on respondents yield conclusions similar to those based on records. Finally, we find that error properties of statistics may differ from error properties of the individual variables used to calculate the statistics.
Comments
Published in Public Opinion Quarterly 70:5 (Special Issue 2006), pp. 737–758; doi 10.1093/ poq/nfl038 Copyright © 2006 Kristen Olson. Published by Oxford University Press on behalf of the American Association for Public Opinion Research. Used by permission. http://poq.oxfordjournals.org/cgi/reprint/70/5/737