Skip to main content
DORAS
DCU Online Research Access Service
Login (DCU Staff Only)
Multiple segmentations of Thai sentences for neural machine translation

Poncelas, Alberto ORCID: 0000-0002-5089-1687, Pidchamook, Wichaya, Liu, Chao-Hong ORCID: 0000-0002-1235-6026, Hadley, James and Way, Andy ORCID: 0000-0001-5736-5930 (2020) Multiple segmentations of Thai sentences for neural machine translation. In: Spoken Language Technologies for Under-resourced languages and Collaboration and Computing for Under-Resourced Languages Workshop, (SLTU-CCURL 2020), 11 - 12 May 2020, Marseille, France. (Virtual).

Full text available as:

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
126kB

Abstract

Thai is a low-resource language, so it is often the case that data is not available in sufficient quantities to train an Neural Machine Translation (NMT) model which perform to a high level of quality. In addition, the Thai script does not use white spaces to delimit the boundaries between words, which adds more complexity when building sequence to sequence models. In this work, we explore how to augment a set of English–Thai parallel data by replicating sentence-pairs with different word segmentation methods on Thai, as training data for NMT model training. Using different merge operations of Byte Pair Encoding, different segmentations of Thai sentences can be obtained. The experiments show that combining these datasets, performance is improved for NMT models trained with a dataset that has been split using a supervised splitting tool.

Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Refereed:Yes
Additional Information:Part of LREC 2020 Workshop Language Resources and Evaluation Conference 11-16 May 2020
Subjects:Computer Science > Machine translating
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
DCU Faculties and Schools > Faculty of Humanities and Social Science > School of Applied Language and Intercultural Studies
Research Initiatives and Centres > ADAPT
Published in: Beermann, Dorothee and Besacier, Laurent and Sakti, Sakriani and Soria, Claudia, (eds.) Proceedings of 1st Joint SLTU and CCURL Workshop (SLTU-CCURL 2020). . LREC.
Publisher:LREC
Official URL:https://lrec2020.lrec-conf.org/media/proceedings/Workshops/Books/SLTUCCURLbook.pdf
Copyright Information:© 2020 The Authors
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:SFI Research Centres Programme (Grant 13/RC/2106), Irish Research Council’s COALESCE scheme (COA- LESCE/2019/117)
ID Code:24440
Deposited On:11 May 2020 15:10 by Alberto Poncelas . Last Modified 22 Jan 2021 14:24

Downloads

Downloads per month over past year

Archive Staff Only: edit this record

Altmetric
- Altmetric
+ Altmetric
  • Student Email
  • Staff Email
  • Student Apps
  • Staff Apps
  • Loop
  • Disclaimer
  • Privacy
  • Contact Us