Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Translation quality assessment: a brief survey on manual and automatic methods

Han, Lifeng orcid logoORCID: 0000-0002-3221-2185, Jones, Gareth J.F. orcid logoORCID: 0000-0003-2923-8365 and Smeaton, Alan F. orcid logoORCID: 0000-0003-1028-8389 (2021) Translation quality assessment: a brief survey on manual and automatic methods. In: MoTra21: Workshop on Modelling Translation: Translatology in the Digital Age, 31 May- 2 Jun 2021, Rejkjavik, Iceland (Online).

Abstract
To facilitate effective translation modeling and translation studies, one of the crucial questions to address is how to assess translation quality. From the perspectives of accuracy, reliability, repeatability and cost, translation quality assessment (TQA) itself is a rich and challenging task. In this work, we present a high-level and concise survey of TQA methods, including both manual judgement criteria and automated evaluation metrics, which we classify into further detailed sub-categories. We hope that this work will be an asset for both translation model researchers and quality assessment researchers. In addition, we hope that it will enable practitioners to quickly develop a better understanding of the conventional TQA field, and to find corresponding closely relevant evaluation solutions for their own needs. This work may also serve inspire further development of quality assessment and evaluation methodologies for other natural language processing (NLP) tasks in addition to machine translation (MT), such as automatic text summarization (ATS), natural language understanding (NLU) and natural language generation (NLG).
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Refereed:Yes
Additional Information:Part of NoDaLiDa21 conference 2021
Uncontrolled Keywords:Translation; Translation Quality; Assessment Methods; Survey, Human Assessment; Automated Assessment
Subjects:Business > Assistive computer technology
Computer Science > Computer engineering
Computer Science > Computer software
Computer Science > Machine translating
Humanities > Language
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Research Institutes and Centres > INSIGHT Centre for Data Analytics
Research Institutes and Centres > ADAPT
Published in: Proceedings of: MoTra21, Workshop on Modelling Translation: Translatology in the Digital Age. . Association for Computational Linguistics (ACL).
Publisher:Association for Computational Linguistics (ACL)
Official URL:https://www.aclweb.org/anthology/2021.motra-1.3.pd...
Copyright Information:© 2021 The Authors
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Science Foundation Ireland (SFI) Research Centres Programme (Grant 13/RC/2106) & the European Regional Development Fund for ADAPT Centre for Digital Content Technology, Science Foundation Ireland under grant number SFI/12/RC/2289 (Insight Centre)
ID Code:25738
Deposited On:05 May 2021 14:44 by Lifeng Han . Last Modified 05 Jan 2022 17:32
Documents

Full text available as:

[thumbnail of MoTra21_paper_3-submitted_camera.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
359kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record