The Journey from Likert to Forced-Choice Questionnaires: Evidence of the Invariance of Item Parameters

Multidimensional forced-choice questionnaires are widely regarded in the personnel selection literature for their ability to control response biases. Recently developed IRT models usually rely on the assumption that item parameters remain invariant when they are paired in forced-choice blocks, witho...

Descripción completa

Detalles Bibliográficos
Autores: Morillo, Daniel, Leenen, Iwin, Hontangas, Pedro, Ponsoda, Vicente
Tipo de recurso: artículo
Fecha de publicación:2019
País:España
Institución:Colegio Oficial de Psicólogos de Madrid
Repositorio:Journal of Work and Organizational Psychology
OAI Identifier:oai:journals.copmadrid.org:jwop/art/jwop2019a11
Acceso en línea:https://doi.org/10.5093/jwop2019a11
Access Level:acceso abierto
Palabra clave:Forced-choice questionnaires, Invariance, IRT, Likelihood Ratio test, MUPP-2PL.
Cuestionarios de elección forzosa, Invarianza, IRT, Test de razón de verosimilitudes, MUPP-2PL.
Descripción
Sumario:Multidimensional forced-choice questionnaires are widely regarded in the personnel selection literature for their ability to control response biases. Recently developed IRT models usually rely on the assumption that item parameters remain invariant when they are paired in forced-choice blocks, without giving it much consideration. This study aims to test this assumption empirically on the MUPP-2PL model, comparing the parameter estimates of the forced-choice format to their graded-scale equivalent on a Big Five personality instrument. The assumption was found to hold reasonably well, especially for the discrimination parameters. In the cases in which it was violated, we briefly discuss the likely factors that may lead to non-invariance. We conclude discussing the practical implications of the results and providing a few guidelines for the design of forced-choice questionnaires based on the invariance assumption.