Semiautomatic generation and assessment of Java exercises in engineering education

[EN] Continuous assessment is essential in education. It should be an integral part of education that provides immediate feedback to students. Unfortunately, the assessment of programming source code is still a hand-operated and error-prone task, and can take weeks before the student gets feedback....

Descripción completa

Detalles Bibliográficos
Autores: Insa Cabrera, David, Pérez-Rubio, Sergio, Tamarit Muñoz, Salvador, Silva, Josep|||0000-0001-5096-0008
Tipo de recurso: artículo
Fecha de publicación:2021
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/176318
Acceso en línea:https://riunet.upv.es/handle/10251/176318
Access Level:acceso abierto
Palabra clave:Assessment tools
Automatic assessment
Evaluation
Java
Marking
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
LENGUAJES Y SISTEMAS INFORMATICOS
QUIMICA ORGANICA
id ES_d502b7e54f499aa4a396cc4e972822cc
oai_identifier_str oai:riunet.upv.es:10251/176318
network_acronym_str ES
network_name_str España
repository_id_str
spelling Semiautomatic generation and assessment of Java exercises in engineering educationInsa Cabrera, DavidPérez-Rubio, SergioTamarit Muñoz, SalvadorSilva, Josep|||0000-0001-5096-0008Assessment toolsAutomatic assessmentEvaluationJavaMarkingCIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIALLENGUAJES Y SISTEMAS INFORMATICOSQUIMICA ORGANICA[EN] Continuous assessment is essential in education. It should be an integral part of education that provides immediate feedback to students. Unfortunately, the assessment of programming source code is still a hand-operated and error-prone task, and can take weeks before the student gets feedback. This study presents a semiautomatic code assessment method able to automatically apply black-box assessment (which relies on the comparison of input-output pairs) and white-box assessment (which relies on checking different source code properties). The method proposed is a general-purpose assessment system that was originally designated to be used in engineering education, but that can be used in other educational contexts to assist the assessment of any Java programming assignments or exams. The main advantage of this system is that the assessment made is quicker, exhaustive, and objective; and it does not produce false positives. After the application of this method over two years in several real university courses, we have released a public and free implementation. An empirical evaluation of this system estimates that the amount of assessment work automatically done by the tool is over 48%. Additionally, the system has been used to measure the average subjective influence (i.e., assessment errors) introduced by teachers when they assess exams manually.MINECO/AEI/FEDER (EU), Grant/Award Number: TIN2016-76843-C4-1-R; Universitat Politecnica de Valencia, Grant/Award Number: FPI Grant PAID-01-18; Generalitat Valenciana, Grant/Award Number: Prometeo/2019/098 (DeepTrust); TAILOR, EU Horizon 2020, Grant/Award Number: GA No 952215John Wiley & SonsDepartamento de Sistemas Informáticos y ComputaciónEscuela Técnica Superior de Ingeniería InformáticaInstituto Universitario Valenciano de Investigación en Inteligencia ArtificialEuropean CommissionGENERALITAT VALENCIANAAGENCIA ESTATAL DE INVESTIGACIONUniversitat Politècnica de ValènciaRepositorio Institucional de la Universitat Politècnica de València Riunet20212021-09-01journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfapplication/pdfhttps://riunet.upv.es/handle/10251/176318reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valénciainstname:Universitat Politècnica de València (UPV)InglésengAgencia Estatal de Investigación http://dx.doi.org/10.13039/501100011033 Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 PID2019-104735RB-C41 SAFER-UPV: ANALISIS Y VALIDACION DE SOFTWARE Y RECURSOS WEBUniversitat Politècnica de València https://doi.org/10.13039/501100004233 PAID-01-18European Commission https://doi.org/10.13039/501100000780 H2020 952215 Foundations of Trustworthy AI - Integrating Reasoning, Learning and OptimizationAgencia Estatal de Investigación http://dx.doi.org/10.13039/501100011033 TIN2016-76843-C4-1-R METODOS RIGUROSOS PARA EL INTERNET DEL FUTUROGeneralitat Valenciana https://doi.org/10.13039/501100003359 PROMETEO%2F2019%2F098 DEEPTRUSTopen accesshttp://purl.org/coar/access_right/c_abf2Reconocimiento - No comercial - Sin obra derivada (by-nc-nd) http://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessoai:riunet.upv.es:10251/1763182026-06-13T07:49:27Z
dc.title.none.fl_str_mv Semiautomatic generation and assessment of Java exercises in engineering education
title Semiautomatic generation and assessment of Java exercises in engineering education
spellingShingle Semiautomatic generation and assessment of Java exercises in engineering education
Insa Cabrera, David
Assessment tools
Automatic assessment
Evaluation
Java
Marking
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
LENGUAJES Y SISTEMAS INFORMATICOS
QUIMICA ORGANICA
title_short Semiautomatic generation and assessment of Java exercises in engineering education
title_full Semiautomatic generation and assessment of Java exercises in engineering education
title_fullStr Semiautomatic generation and assessment of Java exercises in engineering education
title_full_unstemmed Semiautomatic generation and assessment of Java exercises in engineering education
title_sort Semiautomatic generation and assessment of Java exercises in engineering education
dc.creator.none.fl_str_mv Insa Cabrera, David
Pérez-Rubio, Sergio
Tamarit Muñoz, Salvador
Silva, Josep|||0000-0001-5096-0008
author Insa Cabrera, David
author_facet Insa Cabrera, David
Pérez-Rubio, Sergio
Tamarit Muñoz, Salvador
Silva, Josep|||0000-0001-5096-0008
author_role author
author2 Pérez-Rubio, Sergio
Tamarit Muñoz, Salvador
Silva, Josep|||0000-0001-5096-0008
author2_role author
author
author
dc.contributor.none.fl_str_mv Departamento de Sistemas Informáticos y Computación
Escuela Técnica Superior de Ingeniería Informática
Instituto Universitario Valenciano de Investigación en Inteligencia Artificial
European Commission
GENERALITAT VALENCIANA
AGENCIA ESTATAL DE INVESTIGACION
Universitat Politècnica de València
Repositorio Institucional de la Universitat Politècnica de València Riunet
dc.subject.none.fl_str_mv Assessment tools
Automatic assessment
Evaluation
Java
Marking
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
LENGUAJES Y SISTEMAS INFORMATICOS
QUIMICA ORGANICA
topic Assessment tools
Automatic assessment
Evaluation
Java
Marking
CIENCIAS DE LA COMPUTACION E INTELIGENCIA ARTIFICIAL
LENGUAJES Y SISTEMAS INFORMATICOS
QUIMICA ORGANICA
description [EN] Continuous assessment is essential in education. It should be an integral part of education that provides immediate feedback to students. Unfortunately, the assessment of programming source code is still a hand-operated and error-prone task, and can take weeks before the student gets feedback. This study presents a semiautomatic code assessment method able to automatically apply black-box assessment (which relies on the comparison of input-output pairs) and white-box assessment (which relies on checking different source code properties). The method proposed is a general-purpose assessment system that was originally designated to be used in engineering education, but that can be used in other educational contexts to assist the assessment of any Java programming assignments or exams. The main advantage of this system is that the assessment made is quicker, exhaustive, and objective; and it does not produce false positives. After the application of this method over two years in several real university courses, we have released a public and free implementation. An empirical evaluation of this system estimates that the amount of assessment work automatically done by the tool is over 48%. Additionally, the system has been used to measure the average subjective influence (i.e., assessment errors) introduced by teachers when they assess exams manually.
publishDate 2021
dc.date.none.fl_str_mv 2021
2021-09-01
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://riunet.upv.es/handle/10251/176318
url https://riunet.upv.es/handle/10251/176318
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.relation.none.fl_str_mv Agencia Estatal de Investigación http://dx.doi.org/10.13039/501100011033 Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 PID2019-104735RB-C41 SAFER-UPV: ANALISIS Y VALIDACION DE SOFTWARE Y RECURSOS WEB
Universitat Politècnica de València https://doi.org/10.13039/501100004233 PAID-01-18
European Commission https://doi.org/10.13039/501100000780 H2020 952215 Foundations of Trustworthy AI - Integrating Reasoning, Learning and Optimization
Agencia Estatal de Investigación http://dx.doi.org/10.13039/501100011033 TIN2016-76843-C4-1-R METODOS RIGUROSOS PARA EL INTERNET DEL FUTURO
Generalitat Valenciana https://doi.org/10.13039/501100003359 PROMETEO%2F2019%2F098 DEEPTRUST
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reconocimiento - No comercial - Sin obra derivada (by-nc-nd)
http://creativecommons.org/licenses/by-nc-nd/4.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reconocimiento - No comercial - Sin obra derivada (by-nc-nd)
http://creativecommons.org/licenses/by-nc-nd/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv John Wiley & Sons
publisher.none.fl_str_mv John Wiley & Sons
dc.source.none.fl_str_mv reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname:Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869420619230085120
score 15.301603

Similares en LA Referencia