Parra Escartín, CarlaORCID: 0000-0002-8412-1525, Béchara, Hanna and Orăsan, Constantin
(2017)
Questing for quality estimation a user study.
Prague Bulletin of Mathematical Linguistics, 108
(1).
pp. 343-354.
ISSN 1804-0462
Post-Editing of Machine Translation (MT) has become a reality in professional translation
workflows. In order to optimize the management of projects that use post-editing and avoid
underpayments and mistrust from professional translators, effective tools to assess the quality
of Machine Translation (MT) systems need to be put in place. One field of study that could
address this problem is Machine Translation Quality Estimation (MTQE), which aims to determine the quality of MT without an existing reference. Accurate and reliable MTQE can help
project managers and translators alike, as it would allow estimating more precisely the cost of
post-editing projects in terms of time and adequate fares by discarding those segments that are
not worth post-editing (PE) and have to be translated from scratch.
In this paper, we report on the results of an impact study which engages professional translators in PE tasks using MTQE. We measured translators’ productivity in different scenarios:
translating from scratch, post-editing without using MTQE, and post-editing using MTQE. Our
results show that QE information, when accurate, improves post-editing efficiency.