Automated monitoring of human–computer interaction for assessing teachers’ digital competence based on LMS data extraction

The fast-paced evolution of technology has compelled the digitalization of education, requiring educators to interact with computers and develop digital competencies relevant to the teaching–learning process. This need has prompted various organizations to define frameworks for assessing digital com...

Full description

Bibliographic Details
Authors: de Torres, Eduard, Canaleta, Xavi, Fonseca, David, Alsina, Maria
Format: article
Publication Date:2024
Country:España
Institution:Universitat Ramon Llull (URL)
Repository:DAU Arxiu Digital de la Universitat Ramon Llull
OAI Identifier:oai:dau.url.edu:20.500.14342/6089
Online Access:http://hdl.handle.net/20.500.14342/6089
https://doi.org/10.3390/s24113326
Access Level:Open access
Keyword:Automation
Human-computer interaction
Digital literacy
Digital competence
21st century skills
Teacher evaluation
004
378
62
68
id ES_335e2b6b0bac8bcd9c2a871e3224d1f0
oai_identifier_str oai:dau.url.edu:20.500.14342/6089
network_acronym_str ES
network_name_str España
repository_id_str
spelling Automated monitoring of human–computer interaction for assessing teachers’ digital competence based on LMS data extractionde Torres, EduardCanaleta, XaviFonseca, DavidAlsina, MariaAutomationHuman-computer interactionDigital literacyDigital competence21st century skillsTeacher evaluation0043786268The fast-paced evolution of technology has compelled the digitalization of education, requiring educators to interact with computers and develop digital competencies relevant to the teaching–learning process. This need has prompted various organizations to define frameworks for assessing digital competency emphasizing teachers’ interaction with computer technologies in education. Different authors have presented assessment methods for teachers’ digital competence based on the video analysis of recorded classes using sensors such as cameras, microphones, or electroencephalograms. The main limitation of these solutions is the large number of resources they require, making it difficult to assess large numbers of teachers in resource-constrained environments. This article proposes the automation of teachers’ digital competence evaluation process based on monitoring metrics obtained from teachers’ interaction with a Learning Management System (LMS). Based on the Digital Competence Framework for Educators (DigCompEdu), indicators were defined and extracted that allow automatic measurement of a teacher’s competency level. A tool was designed and implemented to conduct a successful proof of concept capable of automating the evaluation process of all university faculty, including 987 lecturers from different fields of knowledge. Results obtained allow for drawing conclusions on technological adoption according to the teacher’s profile and planning educational actions to improve these competencies.info:eu-repo/semantics/publishedVersionMDPIUniversitat Ramon Llull. La Salle2026202620242024info:eu-repo/semantics/article19 p.application/pdfhttp://hdl.handle.net/20.500.14342/6089https://doi.org/10.3390/s24113326reponame:DAU Arxiu Digital de la Universitat Ramon Llullinstname:Universitat Ramon Llull (URL)InglésSensors, 2024. Vol. 24, 11, 3326© L'autor/aAttribution 4.0 Internationalhttp://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:dau.url.edu:20.500.14342/60892026-06-21T06:40:37Z
dc.title.none.fl_str_mv Automated monitoring of human–computer interaction for assessing teachers’ digital competence based on LMS data extraction
title Automated monitoring of human–computer interaction for assessing teachers’ digital competence based on LMS data extraction
spellingShingle Automated monitoring of human–computer interaction for assessing teachers’ digital competence based on LMS data extraction
de Torres, Eduard
Automation
Human-computer interaction
Digital literacy
Digital competence
21st century skills
Teacher evaluation
004
378
62
68
title_short Automated monitoring of human–computer interaction for assessing teachers’ digital competence based on LMS data extraction
title_full Automated monitoring of human–computer interaction for assessing teachers’ digital competence based on LMS data extraction
title_fullStr Automated monitoring of human–computer interaction for assessing teachers’ digital competence based on LMS data extraction
title_full_unstemmed Automated monitoring of human–computer interaction for assessing teachers’ digital competence based on LMS data extraction
title_sort Automated monitoring of human–computer interaction for assessing teachers’ digital competence based on LMS data extraction
dc.creator.none.fl_str_mv de Torres, Eduard
Canaleta, Xavi
Fonseca, David
Alsina, Maria
author de Torres, Eduard
author_facet de Torres, Eduard
Canaleta, Xavi
Fonseca, David
Alsina, Maria
author_role author
author2 Canaleta, Xavi
Fonseca, David
Alsina, Maria
author2_role author
author
author
dc.contributor.none.fl_str_mv Universitat Ramon Llull. La Salle
dc.subject.none.fl_str_mv Automation
Human-computer interaction
Digital literacy
Digital competence
21st century skills
Teacher evaluation
004
378
62
68
topic Automation
Human-computer interaction
Digital literacy
Digital competence
21st century skills
Teacher evaluation
004
378
62
68
description The fast-paced evolution of technology has compelled the digitalization of education, requiring educators to interact with computers and develop digital competencies relevant to the teaching–learning process. This need has prompted various organizations to define frameworks for assessing digital competency emphasizing teachers’ interaction with computer technologies in education. Different authors have presented assessment methods for teachers’ digital competence based on the video analysis of recorded classes using sensors such as cameras, microphones, or electroencephalograms. The main limitation of these solutions is the large number of resources they require, making it difficult to assess large numbers of teachers in resource-constrained environments. This article proposes the automation of teachers’ digital competence evaluation process based on monitoring metrics obtained from teachers’ interaction with a Learning Management System (LMS). Based on the Digital Competence Framework for Educators (DigCompEdu), indicators were defined and extracted that allow automatic measurement of a teacher’s competency level. A tool was designed and implemented to conduct a successful proof of concept capable of automating the evaluation process of all university faculty, including 987 lecturers from different fields of knowledge. Results obtained allow for drawing conclusions on technological adoption according to the teacher’s profile and planning educational actions to improve these competencies.
publishDate 2024
dc.date.none.fl_str_mv 2024
2024
2026
2026
dc.type.none.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv http://hdl.handle.net/20.500.14342/6089
https://doi.org/10.3390/s24113326
url http://hdl.handle.net/20.500.14342/6089
https://doi.org/10.3390/s24113326
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Sensors, 2024. Vol. 24, 11, 3326
dc.rights.none.fl_str_mv © L'autor/a
Attribution 4.0 International
http://creativecommons.org/licenses/by/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv © L'autor/a
Attribution 4.0 International
http://creativecommons.org/licenses/by/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 19 p.
application/pdf
dc.publisher.none.fl_str_mv MDPI
publisher.none.fl_str_mv MDPI
dc.source.none.fl_str_mv reponame:DAU Arxiu Digital de la Universitat Ramon Llull
instname:Universitat Ramon Llull (URL)
instname_str Universitat Ramon Llull (URL)
reponame_str DAU Arxiu Digital de la Universitat Ramon Llull
collection DAU Arxiu Digital de la Universitat Ramon Llull
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869405742246658049
score 15.812429