Skip to main content
DORAS
DCU Online Research Access Service
Login (DCU Staff Only)
Automatic construction of discourse corpora for dialogue translation

Wang, Longyue ORCID: 0000-0002-9062-6183, Zhang, Xiaojun, Tu, Zhaopeng, Way, Andy ORCID: 0000-0001-5736-5930 and Liu, Qun ORCID: 0000-0002-7000-1792 (2016) Automatic construction of discourse corpora for dialogue translation. In: 10th Language Resources and Evaluation Conference, 23-28 May 2016, Portorož, Slovenia. ISBN 978-2-9517408-9-1

Full text available as:

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
638kB

Abstract

In this paper, a novel approach is proposed to automatically construct parallel discourse corpus for dialogue machine translation. Firstly, the parallel subtitle data and its corresponding monolingual movie script data are crawled and collected from Internet. Then tags such as speaker and discourse boundary from the script data are projected to its subtitle data via an information retrieval approach in order to map monolingual discourse to bilingual texts. We not only evaluate the mapping results, but also integrate speaker information into the translation. Experiments show our proposed method can achieve 81.79% and 98.64% accuracy on speaker and dialogue boundary annotation, and speaker-based language model adaptation can obtain around 0.5 BLEU points improvement in translation qualities. Finally, we publicly release around 100K parallel discourse data with manual speaker and dialogue boundary annotation.

Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:Discourse Corpus; Dialogue; Machine Translation; Information Retrieval; Movie Script; Movie Subtitle
Subjects:Computer Science > Machine translating
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Research Initiatives and Centres > ADAPT
Published in: Calzolari, Nicoletta and Choukri, Khalid and Declerck, Thierry and Goggi, Sara, (eds.) Proceedings of the Tenth Language Resources and Evaluation Conference. . European Language Resources Association. ISBN 978-2-9517408-9-1
Publisher:European Language Resources Association
Official URL:http://www.lrec-conf.org/proceedings/lrec2016/pdf/790_Paper.pdf
Copyright Information:© 2016 ELRA
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Science Foundation of Ireland (SFI) ADAPT project (Grant No.:13/RC/2106), DCU-Huawei Joint Project (Grant No.:201504032-A (DCU), YB2015090061 (Huawei), Open Projects Program of National Laboratory of Pattern Recognition (Grant 201407353), Open Projects Program of Centre of Translation of GDUFS (Grant CTS201501)
ID Code:23217
Deposited On:01 May 2019 15:31 by Thomas Murtagh . Last Modified 01 May 2019 15:31

Downloads

Downloads per month over past year

Archive Staff Only: edit this record

Altmetric
- Altmetric
+ Altmetric
  • Student Email
  • Staff Email
  • Student Apps
  • Staff Apps
  • Loop
  • Disclaimer
  • Privacy
  • Contact Us