FoCo: A Shiny App for Formative Assessment using Cognitive Diagnosis Modeling

Combining formative and summative evaluations could improve assessment. Cognitive diagnosis modeling (CDM) has been proposed as a tool for diagnosing students’ strengths and weaknesses in formative assessment. However,there is no user-friendly software to implement it. For this reason,a Shiny app,Fo...

Descripción completa

Detalles Bibliográficos
Autores: Sanz, Susana, Kreitchmann, Rodrigo, Nájera, Pablo, Moreno, José David, Martínez Huertas, José Ángel, Sorrel, Miguel
Tipo de recurso: artículo
Fecha de publicación:2023
País:España
Institución:IE
Repositorio:Repositorio IE
OAI Identifier:oai:repositorio.ie.edu:20.500.14417/3140
Acceso en línea:https://doi.org/10.5093/psed2022a14
https://hdl.handle.net/20.500.14417/3140
https://www.scopus.com/inward/record.uri?eid=2-s2.0-85163996773&doi=10.5093%2fpsed2022a14&partnerID=40&md5=a785db358187a3df945472ca67ed4451
Access Level:acceso abierto
Palabra clave:Cognitive diagnosis modeling
Computer application
Formative assessment
Multiple-choice items
58 Pedagogía
ODS 4 - Educación de calidad
Descripción
Sumario:Combining formative and summative evaluations could improve assessment. Cognitive diagnosis modeling (CDM) has been proposed as a tool for diagnosing students’ strengths and weaknesses in formative assessment. However,there is no user-friendly software to implement it. For this reason,a Shiny app,FoCo,has been developed (https://foco.shinyapps.io/FoCo/),to conduct CDM and classical test theory analyses. The responses from 86 undergraduate students to a research methods course examination were analyzed. Students’ strengths and needs were diagnosed concerning their dominance of the syllabus contents and the first three competencies in Bloom’s taxonomy. The validity of the results was analyzed. The exam showed acceptable about evaluating students’ knowledge,as students with similar scores showed different strengths and weaknesses. Additionally,these attributes were found to predict different relevant criteria. It is expected that FoCo’s easiness to use promotes the employment of CDM in real educational settings. © 2023 Colegio Oficial de la Psicología de Madrid.