Overcoming statistical machine translation limitations: error analysis and proposed solutions for the Catalan–Spanish language pair
This work aims to improve anN-gram-based statistical machine translation system between the Catalan and Spanish languages, trained with an aligned Spanish– Catalan parallel corpus consisting of 1.7 million sentences taken from El Periódico newspaper. Starting from a linguistic error analysis above t...
| Autores: | , , , , , , |
|---|---|
| Tipo de documento: | artigo |
| Data de publicação: | 2011 |
| País: | España |
| Recursos: | Universitat Politècnica de Catalunya (UPC) |
| Repositório: | UPCommons. Portal del coneixement obert de la UPC |
| Idioma: | inglês |
| OAI Identifier: | oai:upcommons.upc.edu:2117/12676 |
| Acesso em linha: | https://hdl.handle.net/2117/12676 https://dx.doi.org/10.1007/s10579-011-9137-0 |
| Access Level: | Acceso aberto |
| Palavra-chave: | Statistical machine translation N-gram-based translation Linguistic knowledge Grammatical categories Signal theory (Telecommunication) Language and Speech Technologies Parla Àrees temàtiques de la UPC::Enginyeria de la telecomunicació |
| Resumo: | This work aims to improve anN-gram-based statistical machine translation system between the Catalan and Spanish languages, trained with an aligned Spanish– Catalan parallel corpus consisting of 1.7 million sentences taken from El Periódico newspaper. Starting from a linguistic error analysis above this baseline system, orthographic, morphological, lexical, semantic and syntactic problems are approached using a set of techniques. The proposed solutions include the development and application of additional statistical techniques, text pre- and post-processing tasks, and rules based on the use of grammatical categories, as well as lexical categorization. The performance of the improved system is clearly increased, as is shown in both human and automatic evaluations of the system, with a gain of about 1.1 points BLEU observed in the Spanish-to-Catalan direction of translation, and a gain of about 0.5 points in the reverse direction. The final system is freely available online as a linguistic resource |
|---|