Multilingual lexical simplification

Treball fi de màster de: Master in Intelligent Interactive Systems

Detalhes bibliográficos
Autor: Pimienta Castillo, Jorge S.
Formato: tesis de maestría
Fecha de publicación:2021
País:España
Recursos:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10230/49224
Acesso em linha:http://hdl.handle.net/10230/49224
Access Level:acceso abierto
Palavra-chave:Complex word identification
Masked language model
Lexical simplification
Word frequency
Model evaluation
id ES_ed2eaaaf142c3ca931d0f7ac7be9e956
oai_identifier_str oai:recercat.cat:10230/49224
network_acronym_str ES
network_name_str España
repository_id_str
spelling Multilingual lexical simplificationPimienta Castillo, Jorge S.Complex word identificationMasked language modelLexical simplificationWord frequencyModel evaluationTreball fi de màster de: Master in Intelligent Interactive SystemsTutor: Horacio SaggionThis report describes, implement, and evaluate one strategy for text simplification, namely, Lexical Simplification, that aims to reduce the complexity of some words in a sentence. This process is done in two main steps, the first, is a module that identifies the complex elements, and the second, is a module that replaces those elements for simpler variants. For the first module, the system will use three different datasets that include human annotations in different languages: English, Spanish, and German, this will allow us to train a classifier that detects complex words. For the second module, a pre-trained model for word prediction (BERT) will be used to generate the candidates, the candidates will be sorted based on Zipf’s frequency, to later select the one with the highest value. Finally, the complete system is evaluated using a test dataset, and a survey designed to collect human annotations and perception of Fluency, Meaning and Simplicity.202120212021info:eu-repo/semantics/masterThesisapplication/pdfapplication/pdfhttp://hdl.handle.net/10230/49224reponame:Recercat. Dipósit de la Recerca de Catalunyainstname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)InglésAttribution-NonCommercial- NoDerivs 4.0 Internationalhttps://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessoai:recercat.cat:10230/492242026-05-29T05:05:01Z
dc.title.none.fl_str_mv Multilingual lexical simplification
title Multilingual lexical simplification
spellingShingle Multilingual lexical simplification
Pimienta Castillo, Jorge S.
Complex word identification
Masked language model
Lexical simplification
Word frequency
Model evaluation
title_short Multilingual lexical simplification
title_full Multilingual lexical simplification
title_fullStr Multilingual lexical simplification
title_full_unstemmed Multilingual lexical simplification
title_sort Multilingual lexical simplification
dc.creator.none.fl_str_mv Pimienta Castillo, Jorge S.
author Pimienta Castillo, Jorge S.
author_facet Pimienta Castillo, Jorge S.
author_role author
dc.subject.none.fl_str_mv Complex word identification
Masked language model
Lexical simplification
Word frequency
Model evaluation
topic Complex word identification
Masked language model
Lexical simplification
Word frequency
Model evaluation
description Treball fi de màster de: Master in Intelligent Interactive Systems
publishDate 2021
dc.date.none.fl_str_mv 2021
2021
2021
dc.type.none.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
dc.identifier.none.fl_str_mv http://hdl.handle.net/10230/49224
url http://hdl.handle.net/10230/49224
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.rights.none.fl_str_mv Attribution-NonCommercial- NoDerivs 4.0 International
https://creativecommons.org/licenses/by-nc-nd/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial- NoDerivs 4.0 International
https://creativecommons.org/licenses/by-nc-nd/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.source.none.fl_str_mv reponame:Recercat. Dipósit de la Recerca de Catalunya
instname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
instname_str Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
reponame_str Recercat. Dipósit de la Recerca de Catalunya
collection Recercat. Dipósit de la Recerca de Catalunya
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869423431400816640
score 15,812429

Registos relacionados