How do LSPs compute MT discounts? Presenting a company’s pipeline and its use

Randy Scansani, Lamis Mhedhbi

Abstract
In this paper we present a pipeline developed at Acolad to test a Machine Translation (MT) engine and compute the discount to be applied when its output is used in production. Our pipeline includes three main steps where quality and productivity are measured through automatic metrics, manual evaluation, and by keeping track of editing and temporal effort during a post-editing task. Thanks to this approach, it is possible to evaluate the output quality and compute an engine-specific discount. Our test pipeline tackles the complexity of transforming productivity measurements into discounts by comparing the outcome of each of the above-mentioned steps to an estimate of the average productivity of translation from scratch. The discount is obtained by subtracting the resulting coefficient from the per-word rate. After a description of the pipeline, the paper presents its application on four engines, discussing its results and showing that our method to estimate post-editing effort through manual evaluation seems to capture the actual productivity. The pipeline relies heavily on the work of professional post-editors, with the aim of creating a mutually beneficial cooperation between users and developers.
Anthology ID:
2020.eamt-1.42
Volume:
Proceedings of the 22nd Annual Conference of the European Association for Machine Translation
Month:
November
Year:
2020
Address:
Lisboa, Portugal
Editors:
André Martins, Helena Moniz, Sara Fumega, Bruno Martins, Fernando Batista, Luisa Coheur, Carla Parra, Isabel Trancoso, Marco Turchi, Arianna Bisazza, Joss Moorkens, Ana Guerberof, Mary Nurminen, Lena Marg, Mikel L. Forcada
Venue:
EAMT
SIG:
Publisher:
European Association for Machine Translation
Note:
Pages:
393–401
Language:
URL:
https://aclanthology.org/2020.eamt-1.42
DOI:
Bibkey:
Cite (ACL):
Randy Scansani and Lamis Mhedhbi. 2020. How do LSPs compute MT discounts? Presenting a company’s pipeline and its use. In Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, pages 393–401, Lisboa, Portugal. European Association for Machine Translation.
Cite (Informal):
How do LSPs compute MT discounts? Presenting a company’s pipeline and its use (Scansani & Mhedhbi, EAMT 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2020.eamt-1.42.pdf
PDF Search