Unsupervised Identification of Translationese

Ella Rabinovich, Shuly Wintner


Abstract
Translated texts are distinctively different from original ones, to the extent that supervised text classification methods can distinguish between them with high accuracy. These differences were proven useful for statistical machine translation. However, it has been suggested that the accuracy of translation detection deteriorates when the classifier is evaluated outside the domain it was trained on. We show that this is indeed the case, in a variety of evaluation scenarios. We then show that unsupervised classification is highly accurate on this task. We suggest a method for determining the correct labels of the clustering outcomes, and then use the labels for voting, improving the accuracy even further. Moreover, we suggest a simple method for clustering in the challenging case of mixed-domain datasets, in spite of the dominance of domain-related features over translation-related ones. The result is an effective, fully-unsupervised method for distinguishing between original and translated texts that can be applied to new domains with reasonable accuracy.
Anthology ID:
Q15-1030
Volume:
Transactions of the Association for Computational Linguistics, Volume 3
Month:
Year:
2015
Address:
Cambridge, MA
Editors:
Michael Collins, Lillian Lee
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
419–432
Language:
URL:
https://aclanthology.org/Q15-1030
DOI:
10.1162/tacl_a_00148
Bibkey:
Cite (ACL):
Ella Rabinovich and Shuly Wintner. 2015. Unsupervised Identification of Translationese. Transactions of the Association for Computational Linguistics, 3:419–432.
Cite (Informal):
Unsupervised Identification of Translationese (Rabinovich & Wintner, TACL 2015)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-1/Q15-1030.pdf
Video:
 https://preview.aclanthology.org/nschneid-patch-1/Q15-1030.mp4