Measuring language distance for historical texts in Basque

Measuring distance between languages, dialects and language varieties, both synchronically and diachronically, is a topic of growing interest in NLP. Based on our Syntactically Annotated Historical COrpus in BAsque (SAHCOBA) and previous work in perplexity-based language distance proposed by Gamallo...

ver descrição completa

Detalhes bibliográficos
Autores: Estarrona Ibarloza, Ainara, Etxeberria Uztarroz, Izaskun, Padilla Moyano, Manuel, Soraluze Irureta, Ander
Formato: artículo
Fecha de publicación:2023
País:España
Recursos:Universidad del País Vasco
Repositorio:Addi. Archivo Digital para la Docencia y la Investigación
OAI Identifier:oai:addi.ehu.eus:10810/69932
Acesso em linha:http://hdl.handle.net/10810/69932
Access Level:acceso abierto
Palavra-chave:language distance
dialectology
basque dialects
historical texts
perplexity
id ES_b6da2eae4643df3501657946dd07747c
oai_identifier_str oai:addi.ehu.eus:10810/69932
network_acronym_str ES
network_name_str España
repository_id_str
spelling Measuring language distance for historical texts in BasqueCálculo de distancia lingüística para textos históricos en euskeraEstarrona Ibarloza, AinaraEtxeberria Uztarroz, IzaskunPadilla Moyano, ManuelSoraluze Irureta, Anderlanguage distancedialectologybasque dialectshistorical textsperplexityMeasuring distance between languages, dialects and language varieties, both synchronically and diachronically, is a topic of growing interest in NLP. Based on our Syntactically Annotated Historical COrpus in BAsque (SAHCOBA) and previous work in perplexity-based language distance proposed by Gamallo, Pichel and Alegria (2017, 2020), we have compared historical corpora with current texts in the standard variety and calculated the language distances between them. As the standard Basque is based on the central dialects, the starting hypothesis is that the oldest texts and the dialects on the extremes will be the most distant. The results obtained have largely confirmed the thesis of traditional dialectology: peripheral dialects show a strong idiosyncrasy and are more distant from the rest.Agence Nationale de la Recherche [ANR-17-CE27-0011-BIM]. MICINN [PID2020-118445GB-I00; RTI2018-098082-J-I00]. Gobierno Vasco [GIC IT1534-22].SEPLN202420242023info:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10810/69932reponame:Addi. Archivo Digital para la Docencia y la Investigacióninstname:Universidad del País VascoIngléshttp://journal.sepln.org/sepln/ojs/ojs/index.php/pln/article/view/6478info:eu-repo/semantics/openAccesshttp://creativecommons.org/licenses/by/4.0/© 2023 Sociedad Española para el Procesamiento del Lenguaje Natural bajo licencia Creative Commons Attribution Licenseoai:addi.ehu.eus:10810/699322026-06-18T09:23:17Z
dc.title.none.fl_str_mv Measuring language distance for historical texts in Basque
Cálculo de distancia lingüística para textos históricos en euskera
title Measuring language distance for historical texts in Basque
spellingShingle Measuring language distance for historical texts in Basque
Estarrona Ibarloza, Ainara
language distance
dialectology
basque dialects
historical texts
perplexity
title_short Measuring language distance for historical texts in Basque
title_full Measuring language distance for historical texts in Basque
title_fullStr Measuring language distance for historical texts in Basque
title_full_unstemmed Measuring language distance for historical texts in Basque
title_sort Measuring language distance for historical texts in Basque
dc.creator.none.fl_str_mv Estarrona Ibarloza, Ainara
Etxeberria Uztarroz, Izaskun
Padilla Moyano, Manuel
Soraluze Irureta, Ander
author Estarrona Ibarloza, Ainara
author_facet Estarrona Ibarloza, Ainara
Etxeberria Uztarroz, Izaskun
Padilla Moyano, Manuel
Soraluze Irureta, Ander
author_role author
author2 Etxeberria Uztarroz, Izaskun
Padilla Moyano, Manuel
Soraluze Irureta, Ander
author2_role author
author
author
dc.subject.none.fl_str_mv language distance
dialectology
basque dialects
historical texts
perplexity
topic language distance
dialectology
basque dialects
historical texts
perplexity
description Measuring distance between languages, dialects and language varieties, both synchronically and diachronically, is a topic of growing interest in NLP. Based on our Syntactically Annotated Historical COrpus in BAsque (SAHCOBA) and previous work in perplexity-based language distance proposed by Gamallo, Pichel and Alegria (2017, 2020), we have compared historical corpora with current texts in the standard variety and calculated the language distances between them. As the standard Basque is based on the central dialects, the starting hypothesis is that the oldest texts and the dialects on the extremes will be the most distant. The results obtained have largely confirmed the thesis of traditional dialectology: peripheral dialects show a strong idiosyncrasy and are more distant from the rest.
publishDate 2023
dc.date.none.fl_str_mv 2023
2024
2024
dc.type.none.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv http://hdl.handle.net/10810/69932
url http://hdl.handle.net/10810/69932
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv http://journal.sepln.org/sepln/ojs/ojs/index.php/pln/article/view/6478
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
http://creativecommons.org/licenses/by/4.0/
eu_rights_str_mv openAccess
rights_invalid_str_mv http://creativecommons.org/licenses/by/4.0/
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv SEPLN
publisher.none.fl_str_mv SEPLN
dc.source.none.fl_str_mv reponame:Addi. Archivo Digital para la Docencia y la Investigación
instname:Universidad del País Vasco
instname_str Universidad del País Vasco
reponame_str Addi. Archivo Digital para la Docencia y la Investigación
collection Addi. Archivo Digital para la Docencia y la Investigación
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869417481074900992
score 15,811543

Registos relacionados