Bootstrapping Transliteration with Constrained Discovery for Low-Resource Languages

Shyam Upadhyay, Jordan Kodner, Dan Roth


Abstract
Generating the English transliteration of a name written in a foreign script is an important and challenging step in multilingual knowledge acquisition and information extraction. Existing approaches to transliteration generation require a large (>5000) number of training examples. This difficulty contrasts with transliteration discovery, a somewhat easier task that involves picking a plausible transliteration from a given list. In this work, we present a bootstrapping algorithm that uses constrained discovery to improve generation, and can be used with as few as 500 training examples, which we show can be sourced from annotators in a matter of hours. This opens the task to languages for which large number of training examples are unavailable. We evaluate transliteration generation performance itself, as well the improvement it brings to cross-lingual candidate generation for entity linking, a typical downstream task. We present a comprehensive evaluation of our approach on nine languages, each written in a unique script.
Anthology ID:
D18-1046
Volume:
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
Month:
October-November
Year:
2018
Address:
Brussels, Belgium
Editors:
Ellen Riloff, David Chiang, Julia Hockenmaier, Jun’ichi Tsujii
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
501–511
Language:
URL:
https://aclanthology.org/D18-1046
DOI:
10.18653/v1/D18-1046
Bibkey:
Cite (ACL):
Shyam Upadhyay, Jordan Kodner, and Dan Roth. 2018. Bootstrapping Transliteration with Constrained Discovery for Low-Resource Languages. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 501–511, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
Bootstrapping Transliteration with Constrained Discovery for Low-Resource Languages (Upadhyay et al., EMNLP 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-3/D18-1046.pdf