Hand in hand: automatic sign Language to English translation
Stein, Daniel, Dreuw, Philippe, Ney, Hermann, Morrissey, Sara and Way, AndyORCID: 0000-0001-5736-5930
(2007)
Hand in hand: automatic sign Language to English translation.
In: TMI-07 - Proceedings of The 11th Conference on Theoretical and Methodological Issues in Machine Translation, 7-9 September 2007, Skövde, Sweden.
In this paper, we describe the first data-driven automatic sign-language-to- speech translation system. While both sign language (SL) recognition and translation techniques exist, both use an intermediate notation system
not directly intelligible for untrained users. We combine a SL recognizing framework with a state-of-the-art phrase-based machine translation (MT) system, using corpora of both American Sign Language and Irish Sign Language
data. In a set of experiments we show the overall results and also illustrate the importance of including a
vision-based knowledge source in the development of a complete SL translation system.