MT or not MT? Do translation specialists know a machine-translated text when they see one?

Rudy Loock, Nathalie Moulard, Quentin Pacinella


Abstract
In this article, we investigate translation specialists’ capacity to identify raw machine translation (MT) output in comparison with so-called “human” translations produced without any use of MT. Specifically, we measure this capacity via an online activity, based on different criteria: (i) degree of expertise (translation students vs. professionals with at least 5 years’ experience), (ii) MT engine (DeepL, Google Translate, Reverso, ChatGPT), and (iii) length of input (1-3 sentences). A complementary, qualitative analysis, based on participants’ feedback, provides interesting insight on how they discriminate between raw MT output and human translations.
Anthology ID:
2025.mtsummit-1.35
Volume:
Proceedings of Machine Translation Summit XX: Volume 1
Month:
June
Year:
2025
Address:
Geneva, Switzerland
Editors:
Pierrette Bouillon, Johanna Gerlach, Sabrina Girletti, Lise Volkart, Raphael Rubino, Rico Sennrich, Ana C. Farinha, Marco Gaido, Joke Daems, Dorothy Kenny, Helena Moniz, Sara Szoc
Venue:
MTSummit
SIG:
Publisher:
European Association for Machine Translation
Note:
Pages:
442–454
Language:
URL:
https://preview.aclanthology.org/mtsummit-25-ingestion/2025.mtsummit-1.35/
DOI:
Bibkey:
Cite (ACL):
Rudy Loock, Nathalie Moulard, and Quentin Pacinella. 2025. MT or not MT? Do translation specialists know a machine-translated text when they see one?. In Proceedings of Machine Translation Summit XX: Volume 1, pages 442–454, Geneva, Switzerland. European Association for Machine Translation.
Cite (Informal):
MT or not MT? Do translation specialists know a machine-translated text when they see one? (Loock et al., MTSummit 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/mtsummit-25-ingestion/2025.mtsummit-1.35.pdf