Abstract
This paper discusses a methodology to measure the usability of machine translated content by end users, comparing lightly post-edited content with raw output and with the usability of source language content. The content selected consists of Online Help articles from a software company for a spreadsheet application, translated from English into German. Three groups of five users each used either the source text - the English version (EN) -, the raw MT version (DE_MT), or the light PE version (DE_PE), and were asked to carry out six tasks. Usability was measured using an eye tracker and cognitive, temporal and pragmatic measures of usability. Satisfaction was measured via a post-task questionnaire presented after the participants had completed the tasks.- Anthology ID:
- L16-1048
- Volume:
- Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
- Month:
- May
- Year:
- 2016
- Address:
- Portorož, Slovenia
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 310–316
- Language:
- URL:
- https://aclanthology.org/L16-1048
- DOI:
- Cite (ACL):
- Sheila Castilho and Sharon O’Brien. 2016. Evaluating the Impact of Light Post-Editing on Usability. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 310–316, Portorož, Slovenia. European Language Resources Association (ELRA).
- Cite (Informal):
- Evaluating the Impact of Light Post-Editing on Usability (Castilho & O’Brien, LREC 2016)
- PDF:
- https://preview.aclanthology.org/emnlp-22-attachments/L16-1048.pdf