He, Yifan, Du, Jinhua ORCID: 0000-0002-3267-4881, Way, Andy ORCID: 0000-0001-5736-5930 and van Genabith, Josef ORCID: 0000-0003-1322-7944 (2010) The DCU dependency-based metric in WMT-MetricsMATR 2010. In: WMT 2010 - Joint Fifth Workshop on Statistical Machine Translation and Metrics MATR, ACL 2010., 15-16 July, Uppsala, Sweden.
Abstract
We describe DCU’s LFG dependencybased
metric submitted to the shared evaluation
task of WMT-MetricsMATR 2010.
The metric is built on the LFG F-structurebased
approach presented in (Owczarzak
et al., 2007). We explore the following
improvements on the original metric: 1)
we replace the in-house LFG parser with
an open source dependency parser that
directly parses strings into LFG dependencies;
2) we add a stemming module
and unigram paraphrases to strengthen the
aligner; 3) we introduce a chunk penalty
following the practice of METEOR to reward
continuous matches; and 4) we introduce
and tune parameters to maximize the
correlation with human judgement. Experiments
show that these enhancements improve
the dependency-based metric's correlation
with human judgement.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Workshop |
Refereed: | Yes |
Subjects: | Computer Science > Machine translating |
DCU Faculties and Centres: | Research Institutes and Centres > Centre for Next Generation Localisation (CNGL) DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing |
Published in: | Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR. . Association for Computational Linguistics. |
Publisher: | Association for Computational Linguistics |
Official URL: | http://www.aclweb.org/anthology/W/W10/W10-1753.pdf |
Copyright Information: | © 2010 Association for Computational Linguistics |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
Funders: | Science Foundation Ireland |
ID Code: | 15796 |
Deposited On: | 10 Nov 2010 14:07 by Shane Harper . Last Modified 09 Nov 2018 15:40 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
477kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record