The journey from Likert to forced-choice questionnaires: Evidence of the invariance of item parameters

Multidimensional forced-choice questionnaires are widely regarded in the personnel selection literature for their ability to control response biases. Recently developed IRT models usually rely on the assumption that item parameters remain invariant when they are paired in forced-choice blocks, witho...

Descripción completa

Detalles Bibliográficos
Autores: Morillo, Daniel, Abad Santos, Francisco, Kreitchmann, Rodrigo S., Leenen, Iwin, Hontangas, Pedro, Ponsada, Vicente
Tipo de recurso: artículo
Fecha de publicación:2019
País:España
Institución:Universidad Autónoma de Madrid
Repositorio:Biblos-e Archivo. Repositorio Institucional de la UAM
Idioma:inglés
OAI Identifier:oai:repositorio.uam.es:10486/691109
Acceso en línea:http://hdl.handle.net/10486/691109
https://dx.doi.org/10.5093/jwop2019a11
Access Level:acceso abierto
Palabra clave:Cuestionarios de elección forzosa
Invarianza
IRT
Test de razón de verosimilitudes
MUPP-2PL
Psicología
Descripción
Sumario:Multidimensional forced-choice questionnaires are widely regarded in the personnel selection literature for their ability to control response biases. Recently developed IRT models usually rely on the assumption that item parameters remain invariant when they are paired in forced-choice blocks, without giving it much consideration. This study aims to test this assumption empirically on the MUPP-2PL model, comparing the parameter estimates of the forced-choice format to their graded-scale equivalent on a Big Five personality instrument. The assumption was found to hold reasonably well, especially for the discrimination parameters. In the cases in which it was violated, we briefly discuss the likely factors that may lead to non-invariance. We conclude discussing the practical implications of the results and providing a few guidelines for the design of forced-choice questionnaires based on the invariance assumption