Machine Translation Models are Zero-Shot Detectors of Translation Direction

Michelle Wastl, Jannis Vamvas, Rico Sennrich


Abstract
Detecting the translation direction of parallel text has applications for machine translation training and evaluation, but also has forensic applications, such as resolving plagiarism or forgery allegations. In this work, we explore an unsupervised approach to translation direction detection based on the simple hypothesis that p(translation|original)>p(original|translation), motivated by the well-known simplification effect in translationese or machine-translationese. In experiments with multilingual machine translation models across 20 translation directions, we confirm the effectiveness of the approach for high-resource language pairs, achieving document-level accuracies of 82–96% for NMT-produced translations, and 60–81% for human translations, depending on the model used.
Anthology ID:
2025.findings-acl.59
Volume:
Findings of the Association for Computational Linguistics: ACL 2025
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1054–1074
Language:
URL:
https://preview.aclanthology.org/landing_page/2025.findings-acl.59/
DOI:
Bibkey:
Cite (ACL):
Michelle Wastl, Jannis Vamvas, and Rico Sennrich. 2025. Machine Translation Models are Zero-Shot Detectors of Translation Direction. In Findings of the Association for Computational Linguistics: ACL 2025, pages 1054–1074, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Machine Translation Models are Zero-Shot Detectors of Translation Direction (Wastl et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/landing_page/2025.findings-acl.59.pdf