Browse DORAS
Browse Theses
Latest Additions
Creative Commons License
Except where otherwise noted, content on this site is licensed for use under a:

Comparative evaluation of research vs. Online MT systems

Toral, Antonio and Gaspari, Federico and Kumar Naskar, Sudip and Way, Andy (2011) Comparative evaluation of research vs. Online MT systems. In: The 15th conference of the European Association for Machine Translation (EAMT 2011), 30th - 31st of May 2011, Leuven, Belgium.

Full text available as:

[img]PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


This paper reports MT evaluation experiments that were conducted at the end of year 1 of the EU-funded CoSyne 1 project for three language combinations, considering translations from German, Italian and Dutch into English. We present a comparative evaluation of the MT software developed within the project against four of the leading free webbased MT systems across a range of state-of-the-art automatic evaluation metrics. The data sets from the news domain that were created and used for training purposes and also for this evaluation exercise, which are available to the research community, are also described. The evaluation results for the news domain are very encouraging: the CoSyne MT software consistently beats the rule-based MT systems, and for translations from Italian and Dutch into English in particular the scores given by some of the standard automatic evaluation metrics are not too distant from those obtained by wellestablished statistical online MT systems.

Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Uncontrolled Keywords:CoSyne;
Subjects:Computer Science > Machine translating
DCU Faculties and Centres:Research Initiatives and Centres > Centre for Next Generation Localisation (CNGL)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Published in:Proceedings of the 15th conference of the European Association for Machine Translation. . European Association for Machine Translation.
Publisher:European Association for Machine Translation
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
ID Code:16410
Deposited On:21 Jul 2011 14:52 by Shane Harper. Last Modified 01 Dec 2016 14:47

Download statistics

Archive Staff Only: edit this record