Sociology, Department of
Date of this Version
2-26-2019
Document Type
Article
Citation
Presented at “Interviewers and Their Effects from a Total Survey Error Perspective Workshop,” University of Nebraska-Lincoln, February 26-28, 2019.
Abstract
Although the collection of survey data is undergoing a notable shift toward online and mixed-mode data collection methods (Baker et al., 2010; Groves, 2011), interviewers are still heavily involved in the majority of survey data collections that serve as a basis for important economic, educational, and public policy decisions. Research supports the notion that interviewer characteristics and task-specific skill levels significantly influence the resulting data quality (see, e.g. Ackermann-Piek, 2018; Billiet & Loosveldt, 1988; Dahlhamer, Cynamon, Gentleman, Piani, & Weiler, 2010; Durand, 2005; Fowler Jr., 1991; Hox & de Leeuw, 2002; Jäckle, Lynn, Sinibaldi, & Tipping, 2013; Sakshaug, Tutz, & Kreuter, 2013; Schnell & Trappman, 2006; Vannette & Krosnick, 2018; West & Blom, 2017; West, Kreuter, & Jaenichen, 2013). Thus, it is not surprising, that the international survey research community has sought opportunities to facilitate intensive exchanges between survey researchers on topics related to interviewer training procedures, fieldwork processes, and interviewer effects at international workshops and conferences (e.g. Workshop on Explaining interviewer effects in interviewer-mediated surveys, Germany: Mannheim, April 2013; Interviewer workshop, USA Nebraska: Lincoln, February 2019; Conferences of the European Survey Research Association, every other year at changing locations).
However, such occurrences tend to be sporadic, one-off events, not designed to promote a continuous, ongoing dialogue of interviewer-related issues in the field. Furthermore, while most of the interviewer literature reports findings on interviewer effects and interviewer training, there is a lack of overarching recommendations and standards for reduction of interviewer effects and the implementation of appropriate interviewer training methods in interviewer-administered surveys. For example, international recommendations for interviewer training are typically quite broad and do not include a high level of detail suitable for prescriptive and standardized implementation in the field (Alcser, Clemens, Holland, Guyer, & Hu, 2016; Daikeler, Silber, Bosnjak, Zabal, & Martin, 2017; Fowler Jr. & Mangione, 1990; Lessler, Eyerman, & Wang, 2008).
In the following proposal, we describe our vision to set up a multi-year scientific exchange and cooperation among a core group of international methods experts on topics related to interviewer involvement in the implementation of scientific surveys. We aim to start with three-year pilot phase to build up an infrastructure for regular knowledge exchanges and sharing of materials. Within this pilot phase, annual or biannual meetings will be organized to discuss best practices, exchange ideas, and identify research gaps on pressing topics pertinent to interviewer surveys. As the major outcome of this scientific network, we plan the production of research-based standards and recommendations reports to be published on various interviewer-related topics.
Comments
Copyright 2019 by the authors.