Logistic calibrated items (LCI) method: does it solve subjectivity in translation evaluation and assessment?

[EN] This research paper introduces a model of translation evaluation called Logistic Calibrated Items method. The aim of LCI method is to maximize a translators’ performance and to identify top competent translators through detecting all parsing items within a source text. Parsing items are extract...

Descripción completa

Detalles Bibliográficos
Autor: Akbari, Alireza
Tipo de recurso: artículo
Fecha de publicación:2019
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/123877
Acceso en línea:https://riunet.upv.es/handle/10251/123877
Access Level:acceso abierto
Palabra clave:Translation evaluation product
Logistic Calibrated Items method
Item difficulty
Item discrimination
Recalculation of scores
id ES_b58f5f73682b5218edf013a08c4f79a5
oai_identifier_str oai:riunet.upv.es:10251/123877
network_acronym_str ES
network_name_str España
repository_id_str
spelling Logistic calibrated items (LCI) method: does it solve subjectivity in translation evaluation and assessment?Akbari, AlirezaTranslation evaluation productLogistic Calibrated Items methodItem difficultyItem discriminationRecalculation of scores[EN] This research paper introduces a model of translation evaluation called Logistic Calibrated Items method. The aim of LCI method is to maximize a translators’ performance and to identify top competent translators through detecting all parsing items within a source text. Parsing items are extracted by the application of Brat software. The purpose of LCI was to identify parsing items having optimal item difficulty and item discrimination values. LCI method involves six stages: (1) holistic scoring; (2) the application of Brat software to extract all parsing items; (3) the calculation of item difficulty; (4) the calculation of item discrimination; (5) the identification of items with optimal item difficulty and item discrimination values; and (6) the recalculation of scores. 125 translation students and 4 professional translation evaluators took part in this research. The final results showed that LCI method was more consistent when compared to holistic method. Limitations and implications were also discussed.Editorial Universitat Politècnica de ValènciaRepositorio Institucional de la Universitat Politècnica de València Riunet20192019-07-19journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttps://riunet.upv.es/handle/10251/123877reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valénciainstname:Universitat Politècnica de València (UPV)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2Reconocimiento - No comercial - Sin obra derivada (by-nc-nd) http://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessoai:riunet.upv.es:10251/1238772026-06-13T07:49:27Z
dc.title.none.fl_str_mv Logistic calibrated items (LCI) method: does it solve subjectivity in translation evaluation and assessment?
title Logistic calibrated items (LCI) method: does it solve subjectivity in translation evaluation and assessment?
spellingShingle Logistic calibrated items (LCI) method: does it solve subjectivity in translation evaluation and assessment?
Akbari, Alireza
Translation evaluation product
Logistic Calibrated Items method
Item difficulty
Item discrimination
Recalculation of scores
title_short Logistic calibrated items (LCI) method: does it solve subjectivity in translation evaluation and assessment?
title_full Logistic calibrated items (LCI) method: does it solve subjectivity in translation evaluation and assessment?
title_fullStr Logistic calibrated items (LCI) method: does it solve subjectivity in translation evaluation and assessment?
title_full_unstemmed Logistic calibrated items (LCI) method: does it solve subjectivity in translation evaluation and assessment?
title_sort Logistic calibrated items (LCI) method: does it solve subjectivity in translation evaluation and assessment?
dc.creator.none.fl_str_mv Akbari, Alireza
author Akbari, Alireza
author_facet Akbari, Alireza
author_role author
dc.contributor.none.fl_str_mv Repositorio Institucional de la Universitat Politècnica de València Riunet
dc.subject.none.fl_str_mv Translation evaluation product
Logistic Calibrated Items method
Item difficulty
Item discrimination
Recalculation of scores
topic Translation evaluation product
Logistic Calibrated Items method
Item difficulty
Item discrimination
Recalculation of scores
description [EN] This research paper introduces a model of translation evaluation called Logistic Calibrated Items method. The aim of LCI method is to maximize a translators’ performance and to identify top competent translators through detecting all parsing items within a source text. Parsing items are extracted by the application of Brat software. The purpose of LCI was to identify parsing items having optimal item difficulty and item discrimination values. LCI method involves six stages: (1) holistic scoring; (2) the application of Brat software to extract all parsing items; (3) the calculation of item difficulty; (4) the calculation of item discrimination; (5) the identification of items with optimal item difficulty and item discrimination values; and (6) the recalculation of scores. 125 translation students and 4 professional translation evaluators took part in this research. The final results showed that LCI method was more consistent when compared to holistic method. Limitations and implications were also discussed.
publishDate 2019
dc.date.none.fl_str_mv 2019
2019-07-19
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://riunet.upv.es/handle/10251/123877
url https://riunet.upv.es/handle/10251/123877
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reconocimiento - No comercial - Sin obra derivada (by-nc-nd)
http://creativecommons.org/licenses/by-nc-nd/4.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reconocimiento - No comercial - Sin obra derivada (by-nc-nd)
http://creativecommons.org/licenses/by-nc-nd/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Editorial Universitat Politècnica de València
publisher.none.fl_str_mv Editorial Universitat Politècnica de València
dc.source.none.fl_str_mv reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname:Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869417373721690112
score 15.300719