Popović, MajaORCID: 0000-0001-8234-8745
(2021)
On nature and causes of observed MT errors.
In: Proceedings of Machine Translation Summit XVIII: Research Track, 16-20 Aug 2021, Online.
This work describes analysis of nature and causes of MT errors observed by different evaluators under guidance of different quality criteria: adequacy and comprehension and and a not specified generic mixture of adequacy and fluency. We report results for three language pairs and two domains and eleven MT systems. Our findings indicate that and despite the fact that some of the identified phenomena depend on domain and/or language and the following set of phenomena can be considered as generally challenging for modern MT systems: rephrasing groups of words and translation of ambiguous source words and translating noun phrases and and mistranslations. Furthermore and we show that the quality criterion also has impact on error perception. Our findings indicate that comprehension and adequacy can be assessed simultaneously by different evaluators and so that comprehension and as an important quality criterion and can be included more often in human evaluations.
European Association for Machine Translation through its 2019 sponsorship of activities programme, Science Foundation Ireland Research Centres Programme (Grant13/RC/2106), European Regional Development Fund.
ID Code:
28359
Deposited On:
23 May 2023 14:06 by
Maja Popovic
. Last Modified 31 May 2023 14:11