Human evaluation of NMT & annual progress report: a case study on Spanish to Korean
This paper proposes the first evaluation of NMT in the Spanish-Korean language pair. Four types of human evaluation -Direct Assessment, Ranking Comparison and MT Post-Editing(MTPE) time/effort- and one semiautomatic methods are applied. The NMT engine is represented by Google Translate in newswire d...
| Autores: | , |
|---|---|
| Formato: | artículo |
| Estado: | Versión publicada |
| Fecha de publicación: | 2020 |
| País: | España |
| Recursos: | Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya) |
| Repositorio: | Recercat. Dipósit de la Recerca de Catalunya |
| OAI Identifier: | oai:dnet:recercat____::71d5e45cb4a4816436e8b239c74418b3 |
| Acesso em linha: | https://hdl.handle.net/10230/73410 http://dx.doi.org/10.5565/REV/TRADUMATICA.241 |
| Access Level: | acceso abierto |
| Palavra-chave: | NMT MT evaluation MT post-editing Spanish-Korean translation |
| Resumo: | This paper proposes the first evaluation of NMT in the Spanish-Korean language pair. Four types of human evaluation -Direct Assessment, Ranking Comparison and MT Post-Editing(MTPE) time/effort- and one semiautomatic methods are applied. The NMT engine is represented by Google Translate in newswire domain. After assessed by six professional translators, the engine demonstrates 78% of performance and 37% productivity gain in MTPE. Additionally, 40.249% of the outputs of the engine are modified with an interval of 15 months, showing 11% of progress rate. |
|---|