Multidimensional assessment of the eTranslation output for English–Slovene

Mateja Arnejšek, Alenka Unk


Abstract
The Slovene language department of the European Commission Directorate-General for Translation has always been an early adopter of new developments in the area of machine translation. In 2018, the department started using neural machine translation produced by the eTranslation in-house engines. In 2019, a multidimensional assessment of the eTranslation output for the language combination English–Slovene was carried out. It was based on two user satisfaction surveys, an analysis of detected and reported errors and an ex post analysis of a sample. As part of the assessment effort, a categorisation of errors was devised in order to raise awareness among translators of the potential pitfalls of neural machine translation.
Anthology ID:
2020.eamt-1.41
Volume:
Proceedings of the 22nd Annual Conference of the European Association for Machine Translation
Month:
November
Year:
2020
Address:
Lisboa, Portugal
Editors:
André Martins, Helena Moniz, Sara Fumega, Bruno Martins, Fernando Batista, Luisa Coheur, Carla Parra, Isabel Trancoso, Marco Turchi, Arianna Bisazza, Joss Moorkens, Ana Guerberof, Mary Nurminen, Lena Marg, Mikel L. Forcada
Venue:
EAMT
SIG:
Publisher:
European Association for Machine Translation
Note:
Pages:
383–392
Language:
URL:
https://aclanthology.org/2020.eamt-1.41
DOI:
Bibkey:
Cite (ACL):
Mateja Arnejšek and Alenka Unk. 2020. Multidimensional assessment of the eTranslation output for English–Slovene. In Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, pages 383–392, Lisboa, Portugal. European Association for Machine Translation.
Cite (Informal):
Multidimensional assessment of the eTranslation output for English–Slovene (Arnejšek & Unk, EAMT 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2020.eamt-1.41.pdf