About Evaluating Bilingual Lexicon Induction

Martin Laville, Emmanuel Morin, Phillippe Langlais


Abstract
With numerous new methods proposed recently, the evaluation of Bilingual Lexicon Induction have been quite hazardous and inconsistent across works. Some studies proposed some guidance to sanitize this; yet, they are not necessarily followed by practitioners. In this study, we try to gather these different recommendations and add our owns, with the aim to propose an unified evaluation protocol. We further show that the easiness of a benchmark while being correlated to the proximity of the language pairs being considered, is even more conditioned on the graphical similarities within the test word pairs.
Anthology ID:
2022.bucc-1.2
Volume:
Proceedings of the BUCC Workshop within LREC 2022
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Reinhard Rapp, Pierre Zweigenbaum, Serge Sharoff
Venue:
BUCC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
8–14
Language:
URL:
https://aclanthology.org/2022.bucc-1.2
DOI:
Bibkey:
Cite (ACL):
Martin Laville, Emmanuel Morin, and Phillippe Langlais. 2022. About Evaluating Bilingual Lexicon Induction. In Proceedings of the BUCC Workshop within LREC 2022, pages 8–14, Marseille, France. European Language Resources Association.
Cite (Informal):
About Evaluating Bilingual Lexicon Induction (Laville et al., BUCC 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/naacl24-info/2022.bucc-1.2.pdf