The Effects of Item Saliency and Question Design on Measurement Error in a Self-Administered Survey

Authors

Michael J. Stern, College of CharlestonFollow
Jolene D. Smyth, University of Nebraska-LincolnFollow
Jeanette Mendez, Oklahoma State UniversityFollow

Document Type

Article

Date of this Version

2012

Citation

Field Methods 24:1 (2012), pp. 3–27.

doi: 10.1177/1525822X11419478

Comments

Copyright © 2012 Michael J. Stern, Jolene D. Smyth, and Jeanette Mendez. Published by SAGE. Used by permission.

Abstract

Recent survey design research has shown that small changes in the structure and visual layout of questions can affect respondents’ answers, but the results are not always consistent across studies. One possible reason for some of the inconsistency may be differences in the item saliency of the questions used in the experiments. In this article, the authors examine how item saliency might influence visual design effects. The authors report the results of three experimental alterations in question format and visual design using data from a 2005 random sample mail survey of 1,315 households. The results suggest that the saliency of the questions has effects both independent of and in concert with the layout of the questions. The implications for survey design are discussed.