Should MT systems be used as black boxes in CLIR?
Magdy, Walid and Jones, Gareth J.F. (2011) Should MT systems be used as black boxes in CLIR? In: The 33rd European Conference on Information Retrieval (ECIR 2011), 18-21 April 2011, Dublin, Ireland.
Full text available as:
The translation stage in cross language information retrieval (CLIR) acts as the main enabling stage to cross the language barrier between documents and queries. In recent years machine translation (MT) systems have become the dominant approach to translation in CLIR. However, unlike information retrieval (IR), MT focuses on the morphological and syntactical quality of the sentence. This requires large training resources and high computational power for training and translation. We present a novel technique for MT designed specifically for CLIR. In this method IR text pre-processing in the form of stop word removal and stemming are applied to the MT training corpus prior to the training phase. Applying this pre-processing step is found to significantly speed up the translation process without affecting the retrieval quality.
Archive Staff Only: edit this record