Hand in hand: automatic sign Language to English translation
Stein, Daniel and Dreuw, Philippe and Ney, Hermann and Morrissey, Sara and Way, Andy (2007) Hand in hand: automatic sign Language to English translation. In: TMI-07 - Proceedings of The 11th Conference on Theoretical and Methodological Issues in Machine Translation, 7-9 September 2007, Skövde, Sweden.
Full text available as:
In this paper, we describe the first data-driven automatic sign-language-to- speech translation system. While both sign language (SL) recognition and translation techniques exist, both use an intermediate notation system
not directly intelligible for untrained users. We combine a SL recognizing framework with a state-of-the-art phrase-based machine translation (MT) system, using corpora of both American Sign Language and Irish Sign Language
data. In a set of experiments we show the overall results and also illustrate the importance of including a
vision-based knowledge source in the development of a complete SL translation system.
Archive Staff Only: edit this record