Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Comparative evaluation of research vs. Online MT systems

Toral, Antonio, Gaspari, Federico, Kumar Naskar, Sudip and Way, Andy orcid logoORCID: 0000-0001-5736-5930 (2011) Comparative evaluation of research vs. Online MT systems. In: The 15th conference of the European Association for Machine Translation (EAMT 2011), 30th - 31st of May 2011, Leuven, Belgium.

This paper reports MT evaluation experiments that were conducted at the end of year 1 of the EU-funded CoSyne 1 project for three language combinations, considering translations from German, Italian and Dutch into English. We present a comparative evaluation of the MT software developed within the project against four of the leading free webbased MT systems across a range of state-of-the-art automatic evaluation metrics. The data sets from the news domain that were created and used for training purposes and also for this evaluation exercise, which are available to the research community, are also described. The evaluation results for the news domain are very encouraging: the CoSyne MT software consistently beats the rule-based MT systems, and for translations from Italian and Dutch into English in particular the scores given by some of the standard automatic evaluation metrics are not too distant from those obtained by wellestablished statistical online MT systems.
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Uncontrolled Keywords:CoSyne;
Subjects:Computer Science > Machine translating
DCU Faculties and Centres:Research Institutes and Centres > Centre for Next Generation Localisation (CNGL)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Published in: Proceedings of the 15th conference of the European Association for Machine Translation. . European Association for Machine Translation.
Publisher:European Association for Machine Translation
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
ID Code:16410
Deposited On:21 Jul 2011 13:52 by Shane Harper . Last Modified 08 Feb 2023 13:50

Full text available as:

[thumbnail of Comparative_Evaluation_of_Research_vs._Online_MT_Systems.pdf]
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


Downloads per month over past year

Archive Staff Only: edit this record