Min, Jinming, Jiang, Jie, Leveling, Johannes ORCID: 0000-0003-0603-4191, Jones, Gareth J.F. ORCID: 0000-0003-2923-8365 and Way, Andy ORCID: 0000-0001-5736-5930 (2010) DCU's experiments in NTCIR-8 IR4QA task. In: NTCIR-8 - The 8th NTCIR Workshop, 15-18 June 2010, Tokyo, Japan. ISBN 978-4-86049-053-9
Abstract
We describe DCU's participation in the NTCIR-8 IR4QA
task [16]. This task is a cross-language information retrieval(CLIR) task from English to Simplified Chinese which seeks to provide relevant documents for later cross language question answering (CLQA) tasks. For the IR4QA task, we submitted 5 official runs including two monolingual runs and three CLIR runs. For the monolingual retrieval we tested two information retrieval models. The results show that the KL-Divergence language model method performs better than the Okapi BM25 model for the Simplified Chinese retrieval task. This agrees with our previous CLIR experimental results at NTCIR-5. For the CLIR task, we compare query translation and document translation methods. In the query translation based runs, we tested a method for query expansion from external resource (QEE) before query translation. Our result for this run is slightly lower than the run without QEE. Our results show that the document translation method achieves 68.24% MAP performance compared to our best query translation run. For the document translation method, we found that the main issue is the lack of named entity translation in the documents since we do not have a suitable parallel corpus for training data for the statistical machine translation system. Our best CLIR run comes from the combination of query translation using Google translate and the KL-Divergence language model retrieval method. It achieves 79.94% MAP relative to our best monolingual run.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Workshop |
Refereed: | Yes |
Subjects: | Computer Science > Machine translating |
DCU Faculties and Centres: | Research Institutes and Centres > Centre for Next Generation Localisation (CNGL) DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing |
Published in: | Proceedings of the 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering, and Cross-Lingual Information Access. . National Institute of Informatics. ISBN 978-4-86049-053-9 |
Publisher: | National Institute of Informatics |
Official URL: | http://research.nii.ac.jp/ntcir/workshop/OnlinePro... |
Copyright Information: | ©2010 National Institute of Informatics (NII) |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
Funders: | Science Foundation Ireland |
ID Code: | 15792 |
Deposited On: | 10 Nov 2010 13:12 by Shane Harper . Last Modified 25 Oct 2018 11:01 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
353kB |
Metrics
Altmetric Badge
Dimensions Badge
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record