Castilho, Sheila ORCID: 0000-0002-8416-6555 and O'Brien, Sharon ORCID: 0000-0003-4864-5986 (2016) Evaluating the impact of light post-editing on usability. In: 10th International Conference on Language Resources and Evaluation, LREC 2016, 23-28 May 2016, Portorož, Slovenia. ISBN 978-2-9517408-9-1
Abstract
This paper discusses a methodology to measure the usability of machine translated content by end users, comparing lightly post-edited
content with raw output and with the usability of source language content. The content selected consists of Online Help articles from a
software company for a spreadsheet application, translated from English into German. Three groups of five users each used either the
source text - the English version (EN) -, the raw MT version (DE_MT), or the light PE version (DE_PE), and were asked to carry out
six tasks. Usability was measured using an eye tracker and cognitive, temporal and pragmatic measures of usability. Satisfaction was
measured via a post-task questionnaire presented after the participants had completed the tasks.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Uncontrolled Keywords: | post-editing; usability; eye tracking; User Satisfaction; Evaluation Methodologies; SpeechToSpeech Translation |
Subjects: | Computer Science > Machine translating |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing DCU Faculties and Schools > Faculty of Humanities and Social Science > School of Applied Language and Intercultural Studies Research Institutes and Centres > ADAPT |
Published in: | Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016. . European Language Resources and Association (ELRA). ISBN 978-2-9517408-9-1 |
Publisher: | European Language Resources and Association (ELRA) |
Official URL: | http://www.lrec-conf.org/proceedings/lrec2016/pdf/... |
Copyright Information: | © 2016 ELRA Creative Commons Attribution-NonCommercial 4.0 International License |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
ID Code: | 23075 |
Deposited On: | 11 Mar 2019 15:59 by Thomas Murtagh . Last Modified 20 Jan 2021 16:42 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
768kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record