Han, Lifeng ORCID: 0000-0002-3221-2185, Jones, Gareth J.F. ORCID: 0000-0003-2923-8365 and Smeaton, Alan F. ORCID: 0000-0003-1028-8389 (2021) Translation quality assessment: a brief survey on manual and automatic methods. In: MoTra21: Workshop on Modelling Translation: Translatology in the Digital Age, 31 May- 2 Jun 2021, Rejkjavik, Iceland (Online).
Abstract
To facilitate effective translation modeling and translation studies, one of the crucial questions to address is how to assess translation quality. From the perspectives of accuracy, reliability, repeatability and cost, translation quality assessment (TQA) itself is a rich and challenging task. In this work, we present a high-level and concise survey of TQA methods, including both manual judgement criteria and automated evaluation metrics, which we classify into further detailed sub-categories. We hope that this work will be an asset for both translation model researchers and quality assessment researchers. In addition, we hope that it will enable practitioners to quickly develop a better understanding of the conventional TQA field, and to find corresponding closely relevant evaluation solutions for their own needs. This work may also serve inspire further development of quality assessment and evaluation methodologies for other natural language processing (NLP) tasks in addition to machine translation (MT), such as automatic text summarization (ATS), natural language understanding (NLU) and natural language generation (NLG).
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Workshop |
Refereed: | Yes |
Additional Information: | Part of NoDaLiDa21 conference 2021 |
Uncontrolled Keywords: | Translation; Translation Quality; Assessment Methods; Survey, Human Assessment; Automated Assessment |
Subjects: | Business > Assistive computer technology Computer Science > Computer engineering Computer Science > Computer software Computer Science > Machine translating Humanities > Language |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing Research Institutes and Centres > INSIGHT Centre for Data Analytics Research Institutes and Centres > ADAPT |
Published in: | Proceedings of: MoTra21, Workshop on Modelling Translation: Translatology in the Digital Age. . Association for Computational Linguistics (ACL). |
Publisher: | Association for Computational Linguistics (ACL) |
Official URL: | https://www.aclweb.org/anthology/2021.motra-1.3.pd... |
Copyright Information: | © 2021 The Authors |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
Funders: | Science Foundation Ireland (SFI) Research Centres Programme (Grant 13/RC/2106) & the European Regional Development Fund for ADAPT Centre for Digital Content Technology, Science Foundation Ireland under grant number SFI/12/RC/2289 (Insight Centre) |
ID Code: | 25738 |
Deposited On: | 05 May 2021 14:44 by Lifeng Han . Last Modified 05 Jan 2022 17:32 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
359kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record