Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

The DCU dependency-based metric in WMT-MetricsMATR 2010

He, Yifan, Du, Jinhua orcid logoORCID: 0000-0002-3267-4881, Way, Andy orcid logoORCID: 0000-0001-5736-5930 and van Genabith, Josef orcid logoORCID: 0000-0003-1322-7944 (2010) The DCU dependency-based metric in WMT-MetricsMATR 2010. In: WMT 2010 - Joint Fifth Workshop on Statistical Machine Translation and Metrics MATR, ACL 2010., 15-16 July, Uppsala, Sweden.

Abstract
We describe DCU’s LFG dependencybased metric submitted to the shared evaluation task of WMT-MetricsMATR 2010. The metric is built on the LFG F-structurebased approach presented in (Owczarzak et al., 2007). We explore the following improvements on the original metric: 1) we replace the in-house LFG parser with an open source dependency parser that directly parses strings into LFG dependencies; 2) we add a stemming module and unigram paraphrases to strengthen the aligner; 3) we introduce a chunk penalty following the practice of METEOR to reward continuous matches; and 4) we introduce and tune parameters to maximize the correlation with human judgement. Experiments show that these enhancements improve the dependency-based metric's correlation with human judgement.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Refereed:Yes
Subjects:Computer Science > Machine translating
DCU Faculties and Centres:Research Institutes and Centres > Centre for Next Generation Localisation (CNGL)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Published in: Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR. . Association for Computational Linguistics.
Publisher:Association for Computational Linguistics
Official URL:http://www.aclweb.org/anthology/W/W10/W10-1753.pdf
Copyright Information:© 2010 Association for Computational Linguistics
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Science Foundation Ireland
ID Code:15796
Deposited On:10 Nov 2010 14:07 by Shane Harper . Last Modified 09 Nov 2018 15:40
Documents

Full text available as:

[thumbnail of The_DCU_Dependency-Based_Metric_in_WMT-MetricsMATR_2010.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
477kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record