FoCo: a Shiny App for formative assessment using cognitive diagnosis modeling

Combining formative and summative evaluations could improve assessment. Cognitive diagnosis modeling (CDM) has been proposed as a tool for diagnosing students’ strengths and weaknesses in formative assessment. However, there is no user-friendly software to implement it. For this reason, a Shiny app,...

Descripción completa

Detalles Bibliográficos
Autores: Sanz Velasco, Susana, Schames Kreitchmann, Rodrigo, Najera Álvarez, Pablo, Moreno Pérez, José David, Martínez-Huertas, José Ángel, Sorrel Luján, Miguel Ángel
Tipo de recurso: artículo
Fecha de publicación:2023
País:España
Institución:Universidad Autónoma de Madrid
Repositorio:Biblos-e Archivo. Repositorio Institucional de la UAM
Idioma:inglés
OAI Identifier:oai:repositorio.uam.es:10486/712080
Acceso en línea:http://hdl.handle.net/10486/712080
https://dx.doi.org/10.5093/psed2022a14
Access Level:acceso abierto
Palabra clave:cognitive diagnosis modeling
computer application
formative assessment
multiple-choice items
Psicología
Descripción
Sumario:Combining formative and summative evaluations could improve assessment. Cognitive diagnosis modeling (CDM) has been proposed as a tool for diagnosing students’ strengths and weaknesses in formative assessment. However, there is no user-friendly software to implement it. For this reason, a Shiny app, FoCo, has been developed (https://foco.shinyapps.io/FoCo/), to conduct CDM and classical test theory analyses. The responses from 86 undergraduate students to a research methods course examination were analyzed. Students’ strengths and needs were diagnosed concerning their dominance of the syllabus contents and the first three competencies in Bloom’s taxonomy. The validity of the results was analyzed. The exam showed acceptable about evaluating students’ knowledge, as students with similar scores showed different strengths and weaknesses. Additionally, these attributes were found to predict different relevant criteria. It is expected that FoCo’s easiness to use promotes the employment of CDM in real educational settings