Reliability score evaluation of continuous assessment tests: A longitudinal study

In this paper, a longitudinal study is presented about the score reliability in continuous assessment tests of the subject Network Architecture II, which is taught in the Telecommunication Technologies and Services Engineering degree, offered at Universidad Autónoma de Madrid, Spain. It is important...

ver descrição completa

Detalhes bibliográficos
Autores: López de Vergara Méndez, Jorge Enrique, Olmos Albacete, Ricardo
Formato: artículo
Fecha de publicación:2019
País:España
Recursos:Universidad Autónoma de Madrid
Repositorio:Biblos-e Archivo. Repositorio Institucional de la UAM
Idioma:inglés
OAI Identifier:oai:repositorio.uam.es:10486/711893
Acesso em linha:http://hdl.handle.net/10486/711893
https://dx.doi.org/10.1177/0020720919879375
Access Level:acceso abierto
Palavra-chave:corrected correlation
Cronbach’s α
internal consistency
Score correlation
test pair correlation
Telecomunicaciones
id ES_cc2c6e7d7e233b62ea47735f86ab10db
oai_identifier_str oai:repositorio.uam.es:10486/711893
network_acronym_str ES
network_name_str España
repository_id_str
spelling Reliability score evaluation of continuous assessment tests: A longitudinal studyLópez de Vergara Méndez, Jorge EnriqueOlmos Albacete, Ricardocorrected correlationCronbach’s αinternal consistencyScore correlationtest pair correlationTelecomunicacionesIn this paper, a longitudinal study is presented about the score reliability in continuous assessment tests of the subject Network Architecture II, which is taught in the Telecommunication Technologies and Services Engineering degree, offered at Universidad Autónoma de Madrid, Spain. It is important to evaluate if scores in tests are reliable, because it shows if the phenomenon under study is measured with precision and low error, which are necessary conditions for a fair assessment. Thus, an analysis is provided about the scores obtained in the 28 continuous assessment tests taken across seven years. Correlation, corrected correlation and Cronbach’s α are used as psychometric indicators. Results show that, in general, there is a high correlation in the students’ scores among the different assessment tests every year, which let us confirm that they have been correctly set out. Additionally, the results are compared among different years, showing that they are similar in the different cohorts. However, variations have also been observed over the years, with tests with poor correlation. Finally, based on the analysed data, a novel method is proposed to early detect problems in the tests’ evaluation before the course ends, by correlating their scores in pairs. A low correlation between two tests in the same year, empirically below 0.2, would imply issues in the evaluationThe authors received no financial support for the research, authorship, and/or publication of this articleSageDepartamento de Psicología Social y MetodologíaDepartamento de Tecnología Electrónica y de las ComunicacionesFacultad de PsicologíaEscuela Politécnica Superior20192019-10-09research articlehttp://purl.org/coar/resource_type/c_2df8fbb1AMhttp://purl.org/coar/version/c_ab4af688f83e57aainfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10486/711893https://dx.doi.org/10.1177/0020720919879375reponame:Biblos-e Archivo. Repositorio Institucional de la UAMinstname:Universidad Autónoma de MadridInglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:repositorio.uam.es:10486/7118932026-06-23T12:46:27Z
dc.title.none.fl_str_mv Reliability score evaluation of continuous assessment tests: A longitudinal study
title Reliability score evaluation of continuous assessment tests: A longitudinal study
spellingShingle Reliability score evaluation of continuous assessment tests: A longitudinal study
López de Vergara Méndez, Jorge Enrique
corrected correlation
Cronbach’s α
internal consistency
Score correlation
test pair correlation
Telecomunicaciones
title_short Reliability score evaluation of continuous assessment tests: A longitudinal study
title_full Reliability score evaluation of continuous assessment tests: A longitudinal study
title_fullStr Reliability score evaluation of continuous assessment tests: A longitudinal study
title_full_unstemmed Reliability score evaluation of continuous assessment tests: A longitudinal study
title_sort Reliability score evaluation of continuous assessment tests: A longitudinal study
dc.creator.none.fl_str_mv López de Vergara Méndez, Jorge Enrique
Olmos Albacete, Ricardo
author López de Vergara Méndez, Jorge Enrique
author_facet López de Vergara Méndez, Jorge Enrique
Olmos Albacete, Ricardo
author_role author
author2 Olmos Albacete, Ricardo
author2_role author
dc.contributor.none.fl_str_mv Departamento de Psicología Social y Metodología
Departamento de Tecnología Electrónica y de las Comunicaciones
Facultad de Psicología
Escuela Politécnica Superior
dc.subject.none.fl_str_mv corrected correlation
Cronbach’s α
internal consistency
Score correlation
test pair correlation
Telecomunicaciones
topic corrected correlation
Cronbach’s α
internal consistency
Score correlation
test pair correlation
Telecomunicaciones
description In this paper, a longitudinal study is presented about the score reliability in continuous assessment tests of the subject Network Architecture II, which is taught in the Telecommunication Technologies and Services Engineering degree, offered at Universidad Autónoma de Madrid, Spain. It is important to evaluate if scores in tests are reliable, because it shows if the phenomenon under study is measured with precision and low error, which are necessary conditions for a fair assessment. Thus, an analysis is provided about the scores obtained in the 28 continuous assessment tests taken across seven years. Correlation, corrected correlation and Cronbach’s α are used as psychometric indicators. Results show that, in general, there is a high correlation in the students’ scores among the different assessment tests every year, which let us confirm that they have been correctly set out. Additionally, the results are compared among different years, showing that they are similar in the different cohorts. However, variations have also been observed over the years, with tests with poor correlation. Finally, based on the analysed data, a novel method is proposed to early detect problems in the tests’ evaluation before the course ends, by correlating their scores in pairs. A low correlation between two tests in the same year, empirically below 0.2, would imply issues in the evaluation
publishDate 2019
dc.date.none.fl_str_mv 2019
2019-10-09
dc.type.none.fl_str_mv research article
http://purl.org/coar/resource_type/c_2df8fbb1
AM
http://purl.org/coar/version/c_ab4af688f83e57aa
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv http://hdl.handle.net/10486/711893
https://dx.doi.org/10.1177/0020720919879375
url http://hdl.handle.net/10486/711893
https://dx.doi.org/10.1177/0020720919879375
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Sage
publisher.none.fl_str_mv Sage
dc.source.none.fl_str_mv reponame:Biblos-e Archivo. Repositorio Institucional de la UAM
instname:Universidad Autónoma de Madrid
instname_str Universidad Autónoma de Madrid
reponame_str Biblos-e Archivo. Repositorio Institucional de la UAM
collection Biblos-e Archivo. Repositorio Institucional de la UAM
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869419674744127488
score 15.300719

Registos relacionados