Micha David Hess
2025
ConLoan: A Contrastive Multilingual Dataset for Evaluating Loanwords
Sina Ahmadi
|
Micha David Hess
|
Elena Álvarez-Mellado
|
Alessia Battisti
|
Cui Ding
|
Anne Göhring
|
Yingqiang Gao
|
Zifan Jiang
|
Andrianos Michail
|
Peshmerge Morad
|
Joel Niklaus
|
Maria Christina Panagiotopoulou
|
Stefano Perrella
|
Juri Opitz
|
Anastassia Shaitarova
|
Rico Sennrich
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Lexical borrowing, the adoption of words from one language into another, is a ubiquitous linguistic phenomenon influenced by geopolitical, societal, and technological factors. This paper introduces ConLoan–a novel contrastive dataset comprising sentences with and without loanwords across 10 languages. Through systematic evaluation using this dataset, we investigate how state-of-the-art machine translation and language models process loanwords compared to their native alternatives. Our experiments reveal that these systems show systematic preferences for loanwords over native terms and exhibit varying performance across languages. These findings provide valuable insights for developing more linguistically robust NLP systems.