Application of cognitive diagnosis models to competency-based situational judgment tests

Profiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of t...

Descripción completa

Detalles Bibliográficos
Autores: García, Pablo Eduardo, Olea Díaz, Julio, Torre, Jimmy de la
Tipo de recurso: artículo
Fecha de publicación:2014
País:España
Institución:Universidad Autónoma de Madrid
Repositorio:Biblos-e Archivo. Repositorio Institucional de la UAM
Idioma:inglés
OAI Identifier:oai:repositorio.uam.es:10486/665721
Acceso en línea:http://hdl.handle.net/10486/665721
https://dx.doi.org/10.7334/psicothema2013.322
Access Level:acceso abierto
Palabra clave:Cognitive diagnosis models (CDM)
G-DINA model
Situational judgment tests (SJT)
Great eight model
Modelo great eight
Modelos de diagnóstico cognitivo (MDC)
Modelo G-DINA
Tests de juicio situacional (TJS)
Empresa
Psicología
Descripción
Sumario:Profiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of this paper is to evaluate whether the application of cognitive diagnosis models (CDM) to competency-based SJTs can ascertain the underlying competencies measured by the items, and whether these competencies can be estimated precisely. Method: The generalized deterministic inputs, noisy “and” gate (G-DINA) model was applied to 26 situational judgment items measuring professional competencies based on the great eight model. These items were applied to 485 employees of a Spanish fi nancial company. The fi t of the model to the data and the convergent validity between the estimated competencies and personality dimensions were examined. Results: The G-DINA showed a good fi t to the data and the estimated competency factors, adapting and coping and interacting and presenting were positively related to emotional stability and extraversion, respectively. Conclusions: This work indicates that CDM can be a useful tool when measuring professional competencies through SJTs. CDM can clarify the competencies being measured and provide precise estimates of these competencies