Human evaluation of NMT & annual progress report: a case study on Spanish to Korean
This paper proposes the first evaluation of NMT in the Spanish-Korean language pair. Four types of human evaluation -Direct Assessment, Ranking Comparison and MT Post-Editing(MTPE) time/effort- and one semiautomatic methods are applied. The NMT engine is represented by Google Translate in newswire d...
| Authors: | , |
|---|---|
| Format: | article |
| Status: | Published version |
| Publication Date: | 2020 |
| Country: | España |
| Institution: | Universitat Pompeu Fabra |
| Repository: | Repositorio Digital de la UPF |
| OAI Identifier: | oai:dnet:rdupf_______::0c63192accb8c46c5a1fcb209eb3f5cf |
| Online Access: | https://hdl.handle.net/10230/73410 http://dx.doi.org/10.5565/REV/TRADUMATICA.241 |
| Access Level: | Open access |
| Keyword: | NMT MT evaluation MT post-editing Spanish-Korean translation |
| Summary: | This paper proposes the first evaluation of NMT in the Spanish-Korean language pair. Four types of human evaluation -Direct Assessment, Ranking Comparison and MT Post-Editing(MTPE) time/effort- and one semiautomatic methods are applied. The NMT engine is represented by Google Translate in newswire domain. After assessed by six professional translators, the engine demonstrates 78% of performance and 37% productivity gain in MTPE. Additionally, 40.249% of the outputs of the engine are modified with an interval of 15 months, showing 11% of progress rate. |
|---|