Browse DORAS
Browse Theses
Latest Additions
Creative Commons License
Except where otherwise noted, content on this site is licensed for use under a:

Lost in translation: the problems of using mainstream MT evaluation metrics for sign language translation

Morrissey, Sara and Way, Andy (2006) Lost in translation: the problems of using mainstream MT evaluation metrics for sign language translation. In: SALTMIL 2006 - 5th SALTMIL Workshop on Minority Languages, 23 May 2006, Genoa, Italy.

Full text available as:

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


In this paper we consider the problems of applying corpus-based techniques to minority languages that are neither politically recognised nor have a formally accepted writing system, namely sign languages. We discuss the adoption of an annotated form of sign language data as a suitable corpus for the development of a data-driven machine translation (MT) system, and deal with issues that arise from its use. Useful software tools that facilitate easy annotation of video data are also discussed. Furthermore, we address the problems of using traditional MT evaluation metrics for sign language translation. Based on the candidate translations produced from our example-based machine translation system, we discuss why standard metrics fall short of providing an accurate evaluation and suggest more suitable evaluation methods.

Item Type:Conference or Workshop Item (Poster)
Event Type:Workshop
Uncontrolled Keywords:sign language;
Subjects:Computer Science > Machine translating
DCU Faculties and Centres:Research Initiatives and Centres > National Centre for Language Technology (NCLT)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Official URL:
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Irish Research Council for Science Engineering and Technology, IBM
ID Code:15283
Deposited On:11 Mar 2010 12:07 by DORAS Administrator. Last Modified 28 Apr 2010 09:49

Download statistics

Archive Staff Only: edit this record