Relative mode effects on data quality in mixed-mode surveys by an instrumental variable

In order to compare data-quality of different data-collection modes, multitrait-multimethod (MTMM) experiments have been implemented in a mixed-mode experiment parallel to the European Social Survey (ESS) fourth round (2008/2009). Special interest lies in measurement effects between the modes which...

Descripción completa

Detalles Bibliográficos
Autores: Vannieuwenhuyze, Jorre T.A., Revilla, Melanie
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2013
País:España
Institución:Universitat Pompeu Fabra
Repositorio:Repositorio Digital de la UPF
OAI Identifier:oai:repositori.upf.edu:10230/43537
Acceso en línea:http://hdl.handle.net/10230/43537
http://dx.doi.org/10.18148/srm/2013.v7i3.5137
Access Level:acceso abierto
Palabra clave:Mode effects
Measurement effects
Selection effects
Multitrait-multimethod
Reliability
Validity
Quality
European Social Survey
Descripción
Sumario:In order to compare data-quality of different data-collection modes, multitrait-multimethod (MTMM) experiments have been implemented in a mixed-mode experiment parallel to the European Social Survey (ESS) fourth round (2008/2009). Special interest lies in measurement effects between the modes which refer to the pure impact of a data-collection mode on the quality. Nevertheless, mere comparison between quality estimates of the different modes does not allow drawing conclusions about measurement effects. Indeed, measurement effects may be completely confounded with selection effects which refer to differences in respondents compositions across the modes. However, by comparing the mixed-mode data with the main ESS data and treating the dataset of origin as an instrumental variable, some conditional measurement effects and selection effects can be disentangled. This paper provides a preliminary exploratory analysis of this approach. The results generally yield low to fair measurement effects while the selection effects on some items are rather large.