Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Machine translation evaluation resources and methods: a survey

Han, Lifeng orcid logoORCID: 0000-0002-3221-2185 (2018) Machine translation evaluation resources and methods: a survey. In: IPRC- Irish Postgraduate Research Conference, 8-9 Nov 2018, Dublin, Ireland.

Abstract
We introduce the Machine Translation (MT) evaluation survey that contains both manual and automatic evaluation methods. The traditional human evaluation criteria mainly include the intelligibility, fidelity, fluency, adequacy, comprehension, and informativeness. The advanced human assessments include task-oriented measures, post-editing, segment ranking, and extended criteriea, etc. We classify the automatic evaluation methods into two categories, including lexical similarity scenario and linguistic features application. The lexical similarity methods contain edit distance, precision, recall, F-measure, and word order. The linguistic features can be divided into syntactic features and semantic features respectively. The syntactic features include part of speech tag, phrase types and sentence structures, and the semantic features include named entity, synonyms, textual entailment, paraphrase, semantic roles, and language models. The deep learning models for evaluation are very newly proposed. Subsequently, we also introduce the evaluation methods for MT evaluation including different correlation scores, and the recent quality estimation (QE) tasks for MT. This paper differs from the existing works\cite {GALEprogram2009, EuroMatrixProject2007} from several aspects, by introducing some recent development of MT evaluation measures, the different classifications from manual to automatic evaluation measures, the introduction of recent QE tasks of MT, and the concise construction of the content.
Metadata
Item Type:Conference or Workshop Item (Poster)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:Machine Translation Evaluation
Subjects:Computer Science > Algorithms
Computer Science > Artificial intelligence
Computer Science > Computational linguistics
Computer Science > Machine translating
Humanities > Language
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Research Institutes and Centres > ADAPT
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Science Foundation Ireland (SFI) Research Centres Programme (Grant 13/RC/2106), European Regional Development Fund, NWO VICI under Grant No. 277-89- 002 of Netherlands, Research Committee of the University of Macau (Grant No. MYRG2015-00175-FST and MYRG2015-00188- FST), Science and Technology Development Fund of Macau (Grant No. 057/2014/A)
ID Code:24493
Deposited On:26 May 2020 12:30 by Lifeng Han . Last Modified 20 Sep 2021 13:08
Documents

Full text available as:

[thumbnail of 20201006_Machine Translation Evaluation Resources and Methods_ A Survey.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
739kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record