Application of cognitive diagnosis models to competency-based situational judgment tests

Profiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of t...

Descripción completa

Detalles Bibliográficos
Autores: García, Pablo Eduardo, Olea Díaz, Julio, Torre, Jimmy de la
Tipo de recurso: artículo
Fecha de publicación:2014
País:España
Institución:Universidad Autónoma de Madrid
Repositorio:Biblos-e Archivo. Repositorio Institucional de la UAM
Idioma:inglés
OAI Identifier:oai:repositorio.uam.es:10486/665721
Acceso en línea:http://hdl.handle.net/10486/665721
https://dx.doi.org/10.7334/psicothema2013.322
Access Level:acceso abierto
Palabra clave:Cognitive diagnosis models (CDM)
G-DINA model
Situational judgment tests (SJT)
Great eight model
Modelo great eight
Modelos de diagnóstico cognitivo (MDC)
Modelo G-DINA
Tests de juicio situacional (TJS)
Empresa
Psicología
id ES_a583ecb802a32fbb33dbf63c96b5cd8d
oai_identifier_str oai:repositorio.uam.es:10486/665721
network_acronym_str ES
network_name_str España
repository_id_str
spelling Application of cognitive diagnosis models to competency-based situational judgment testsGarcía, Pablo EduardoOlea Díaz, JulioTorre, Jimmy de laCognitive diagnosis models (CDM)G-DINA modelSituational judgment tests (SJT)Great eight modelModelo great eightModelos de diagnóstico cognitivo (MDC)Modelo G-DINATests de juicio situacional (TJS)EmpresaPsicologíaProfiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of this paper is to evaluate whether the application of cognitive diagnosis models (CDM) to competency-based SJTs can ascertain the underlying competencies measured by the items, and whether these competencies can be estimated precisely. Method: The generalized deterministic inputs, noisy “and” gate (G-DINA) model was applied to 26 situational judgment items measuring professional competencies based on the great eight model. These items were applied to 485 employees of a Spanish fi nancial company. The fi t of the model to the data and the convergent validity between the estimated competencies and personality dimensions were examined. Results: The G-DINA showed a good fi t to the data and the estimated competency factors, adapting and coping and interacting and presenting were positively related to emotional stability and extraversion, respectively. Conclusions: This work indicates that CDM can be a useful tool when measuring professional competencies through SJTs. CDM can clarify the competencies being measured and provide precise estimates of these competenciesMuchas organizaciones definen sus puestos de trabajo en base a las competencias profesionales que requieren. La medición de tales competencias mediante tests de juicio situacional (TJS) presenta problemas de validez, en tanto no suele estar claro los constructos que miden. El objetivo principal de este estudio es evaluar si la aplicación de los modelos de diagnóstico cognitivo (MDC) a estos tests permite clarificar y estimar de forma precisa las competencias medidas. Método: se aplicó el modelo G-DINA (generalized deterministic inputs, noisy “and” gate) a 26 ítems de juicio situacional que medían competencias profesionales fundamentadas en el modelo great eight. Se aplicó el test a 485 trabajadores de una entidad financiera española. Se examinó el ajuste del modelo a los datos, y la validez convergente entre las competencias estimadas y dimensiones de personalidad. Resultados: G-DINA mostró un buen ajuste a los datos, y los factores competenciales estimados adaptarse y aguantar, e interactuar y presentar mostraron una relación positiva con estabilidad emocional y extraversión, respectivamente. Conclusiones: este trabajo muestra que los MDC pueden ser una herramienta útil para la medición de competencias profesionales a través de TJS, aclarando las competencias que miden y obteniendo estimaciones precisas de las mismasThis research was supported in part by the UAM-IIC Chair for Psychometric Models and ApplicationsColegio Oficial de Psicólogos del Principado de AsturiasDepartamento de Psicología Social y MetodologíaFacultad de Psicología20142014-08-01research articlehttp://purl.org/coar/resource_type/c_2df8fbb1VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10486/665721https://dx.doi.org/10.7334/psicothema2013.322reponame:Biblos-e Archivo. Repositorio Institucional de la UAMinstname:Universidad Autónoma de MadridInglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:repositorio.uam.es:10486/6657212026-06-23T12:46:27Z
dc.title.none.fl_str_mv Application of cognitive diagnosis models to competency-based situational judgment tests
title Application of cognitive diagnosis models to competency-based situational judgment tests
spellingShingle Application of cognitive diagnosis models to competency-based situational judgment tests
García, Pablo Eduardo
Cognitive diagnosis models (CDM)
G-DINA model
Situational judgment tests (SJT)
Great eight model
Modelo great eight
Modelos de diagnóstico cognitivo (MDC)
Modelo G-DINA
Tests de juicio situacional (TJS)
Empresa
Psicología
title_short Application of cognitive diagnosis models to competency-based situational judgment tests
title_full Application of cognitive diagnosis models to competency-based situational judgment tests
title_fullStr Application of cognitive diagnosis models to competency-based situational judgment tests
title_full_unstemmed Application of cognitive diagnosis models to competency-based situational judgment tests
title_sort Application of cognitive diagnosis models to competency-based situational judgment tests
dc.creator.none.fl_str_mv García, Pablo Eduardo
Olea Díaz, Julio
Torre, Jimmy de la
author García, Pablo Eduardo
author_facet García, Pablo Eduardo
Olea Díaz, Julio
Torre, Jimmy de la
author_role author
author2 Olea Díaz, Julio
Torre, Jimmy de la
author2_role author
author
dc.contributor.none.fl_str_mv Departamento de Psicología Social y Metodología
Facultad de Psicología
dc.subject.none.fl_str_mv Cognitive diagnosis models (CDM)
G-DINA model
Situational judgment tests (SJT)
Great eight model
Modelo great eight
Modelos de diagnóstico cognitivo (MDC)
Modelo G-DINA
Tests de juicio situacional (TJS)
Empresa
Psicología
topic Cognitive diagnosis models (CDM)
G-DINA model
Situational judgment tests (SJT)
Great eight model
Modelo great eight
Modelos de diagnóstico cognitivo (MDC)
Modelo G-DINA
Tests de juicio situacional (TJS)
Empresa
Psicología
description Profiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of this paper is to evaluate whether the application of cognitive diagnosis models (CDM) to competency-based SJTs can ascertain the underlying competencies measured by the items, and whether these competencies can be estimated precisely. Method: The generalized deterministic inputs, noisy “and” gate (G-DINA) model was applied to 26 situational judgment items measuring professional competencies based on the great eight model. These items were applied to 485 employees of a Spanish fi nancial company. The fi t of the model to the data and the convergent validity between the estimated competencies and personality dimensions were examined. Results: The G-DINA showed a good fi t to the data and the estimated competency factors, adapting and coping and interacting and presenting were positively related to emotional stability and extraversion, respectively. Conclusions: This work indicates that CDM can be a useful tool when measuring professional competencies through SJTs. CDM can clarify the competencies being measured and provide precise estimates of these competencies
publishDate 2014
dc.date.none.fl_str_mv 2014
2014-08-01
dc.type.none.fl_str_mv research article
http://purl.org/coar/resource_type/c_2df8fbb1
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv http://hdl.handle.net/10486/665721
https://dx.doi.org/10.7334/psicothema2013.322
url http://hdl.handle.net/10486/665721
https://dx.doi.org/10.7334/psicothema2013.322
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Colegio Oficial de Psicólogos del Principado de Asturias
publisher.none.fl_str_mv Colegio Oficial de Psicólogos del Principado de Asturias
dc.source.none.fl_str_mv reponame:Biblos-e Archivo. Repositorio Institucional de la UAM
instname:Universidad Autónoma de Madrid
instname_str Universidad Autónoma de Madrid
reponame_str Biblos-e Archivo. Repositorio Institucional de la UAM
collection Biblos-e Archivo. Repositorio Institucional de la UAM
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869415621864718336
score 15,300719

Similares en LA Referencia