Um Método Baseado na Teoria da Resposta ao Item para Avaliação e Feedback Automático no Contexto de Educação Digital

The assessment of students’ knowledge is a common task in the field of education, either to assess learning or to mediate the selection of candidates in entrance exams. Exams that employ an assessment based on multiple choice questions, in which the student marks items during the exam time and then...

Descripción completa

Detalles Bibliográficos
Autores: Monteiro, Edwin Juan Lopes Barboza, Leitão, Gabriel de Souza, Barreto, Raimundo da Silva
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2021
País:Brasil
Institución:Sociedade Brasileira de Computação (SBC)
Repositorio:Revista Brasileira de Informática na Educação
Idioma:portugués
OAI Identifier:oai:journals-sol.sbc.org.br:article/2969
Acceso en línea:https://journals-sol.sbc.org.br/index.php/rbie/article/view/2969
Access Level:acceso abierto
Palabra clave:Formative Feedback
Item Response Theory
Automatic Evaluation
Virtual Learning Environment
IRT
VLE
Feedback Formativo
Teoria da Resposta ao Item
Avaliação Automática
Ambiente Virtual de Aprendizagem
TRI
AVA
Descripción
Sumario:The assessment of students’ knowledge is a common task in the field of education, either to assess learning or to mediate the selection of candidates in entrance exams. Exams that employ an assessment based on multiple choice questions, in which the student marks items during the exam time and then receives feedback on his grade, do not offer the student significant contributions to understanding his performance. The general objective of this study is to provide, for both students and teachers, formative feedback from the estimation of the ability of students and difficulty of the items, through a statistical technique called Item Response Theory (IRT). This technique produces a model of data on student performance based on the analysis of the responses collected in the exams. An experiment was carried out using data from an exam applied in a public high school in Amazonas. The results obtained indicate that there is a valuable amount of information that allows analyzing the relationship between the various items and the estimated abilities. It is possible to classify students on a hability scale so that the student himself can locate his position in a discipline and simulate which topics can be studied to obtain greater hability. From the teacher’s point of view, it is possible to analyze which topics were more difficult for the class, as well as to analyze whether an elaborated item is in accordance with the classes taught. Otherwise, the teacher can redo the item or change the difficulty level. The results provided significant information that allows the elaboration of formative feedback capable of providing the examinees and evaluators with the necessary guidelines to investigate difficulties and contribute to a better performance in the teaching-learning process.