Labelled dependencies in machine translation evaluation
Owczarzak, Karolina, van Genabith, Josef and Way, AndyORCID: 0000-0001-5736-5930
(2007)
Labelled dependencies in machine translation evaluation.
In: ACL 2007 Workshop on Statistical Machine Translation, 23 June 2007, Prague, Czech Republic.
We present a method for evaluating the quality of Machine Translation (MT) output, using labelled dependencies
produced by a Lexical-Functional Grammar (LFG) parser. Our dependency based method, in contrast to most popular
string-based evaluation metrics, does not unfairly penalize perfectly valid syntactic variations in the translation, and the addition of WordNet provides a way to accommodate lexical variation. In comparison with other metrics on 16,800
sentences of Chinese-English newswire text, our method reaches high correlation with human scores.