Application of cognitive diagnosis models to competency-based situational judgment tests
Profiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of t...
| Authors: | , , |
|---|---|
| Format: | article |
| Publication Date: | 2014 |
| Country: | España |
| Institution: | Universidad Autónoma de Madrid |
| Repository: | Biblos-e Archivo. Repositorio Institucional de la UAM |
| Language: | English |
| OAI Identifier: | oai:repositorio.uam.es:10486/665721 |
| Online Access: | http://hdl.handle.net/10486/665721 https://dx.doi.org/10.7334/psicothema2013.322 |
| Access Level: | Open access |
| Keyword: | Cognitive diagnosis models (CDM) G-DINA model Situational judgment tests (SJT) Great eight model Modelo great eight Modelos de diagnóstico cognitivo (MDC) Modelo G-DINA Tests de juicio situacional (TJS) Empresa Psicología |
| Summary: | Profiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of this paper is to evaluate whether the application of cognitive diagnosis models (CDM) to competency-based SJTs can ascertain the underlying competencies measured by the items, and whether these competencies can be estimated precisely. Method: The generalized deterministic inputs, noisy “and” gate (G-DINA) model was applied to 26 situational judgment items measuring professional competencies based on the great eight model. These items were applied to 485 employees of a Spanish fi nancial company. The fi t of the model to the data and the convergent validity between the estimated competencies and personality dimensions were examined. Results: The G-DINA showed a good fi t to the data and the estimated competency factors, adapting and coping and interacting and presenting were positively related to emotional stability and extraversion, respectively. Conclusions: This work indicates that CDM can be a useful tool when measuring professional competencies through SJTs. CDM can clarify the competencies being measured and provide precise estimates of these competencies |
|---|