Toral, Antonio, Gaspari, Federico, Kumar Naskar, Sudip and Way, Andy ORCID: 0000-0001-5736-5930 (2011) Comparative evaluation of research vs. Online MT systems. In: The 15th conference of the European Association for Machine Translation (EAMT 2011), 30th - 31st of May 2011, Leuven, Belgium.
Abstract
This paper reports MT evaluation experiments that were conducted at the end of year 1 of the EU-funded CoSyne
1 project for three language combinations, considering translations from German, Italian and Dutch into English. We present a comparative evaluation of the MT software developed within the project against four of the leading free webbased MT systems across a range of state-of-the-art automatic evaluation metrics. The data sets from the news domain that were created and used for training purposes and also for this evaluation exercise, which are available to the research community, are also described. The evaluation results for the news domain are very encouraging: the CoSyne MT software consistently beats the rule-based MT systems, and for translations from Italian and Dutch into English in particular the scores given by some of the standard automatic evaluation metrics are not too distant from those obtained by wellestablished statistical online MT systems.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Uncontrolled Keywords: | CoSyne; |
Subjects: | Computer Science > Machine translating |
DCU Faculties and Centres: | Research Institutes and Centres > Centre for Next Generation Localisation (CNGL) DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing |
Published in: | Proceedings of the 15th conference of the European Association for Machine Translation. . European Association for Machine Translation. |
Publisher: | European Association for Machine Translation |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
ID Code: | 16410 |
Deposited On: | 21 Jul 2011 13:52 by Shane Harper . Last Modified 08 Feb 2023 13:50 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
166kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record