Human evaluation of NMT & annual progress report: a case study on Spanish to Korean
This paper proposes the first evaluation of NMT in the Spanish-Korean language pair. Four types of human evaluation -Direct Assessment, Ranking Comparison and MT Post-Editing(MTPE) time/effort- and one semiautomatic methods are applied. The NMT engine is represented by Google Translate in newswire d...
| Autores: | , |
|---|---|
| Tipo de recurso: | artículo |
| Estado: | Versión publicada |
| Fecha de publicación: | 2020 |
| País: | España |
| Institución: | Universitat Pompeu Fabra |
| Repositorio: | Repositorio Digital de la UPF |
| OAI Identifier: | oai:dnet:rdupf_______::0c63192accb8c46c5a1fcb209eb3f5cf |
| Acceso en línea: | https://hdl.handle.net/10230/73410 http://dx.doi.org/10.5565/REV/TRADUMATICA.241 |
| Access Level: | acceso abierto |
| Palabra clave: | NMT MT evaluation MT post-editing Spanish-Korean translation |
| Sumario: | This paper proposes the first evaluation of NMT in the Spanish-Korean language pair. Four types of human evaluation -Direct Assessment, Ranking Comparison and MT Post-Editing(MTPE) time/effort- and one semiautomatic methods are applied. The NMT engine is represented by Google Translate in newswire domain. After assessed by six professional translators, the engine demonstrates 78% of performance and 37% productivity gain in MTPE. Additionally, 40.249% of the outputs of the engine are modified with an interval of 15 months, showing 11% of progress rate. |
|---|