TRANSLIT: A Large-scale Name Transliteration Resource
Fernando Benites, Gilbert François Duivesteijn, Pius von Däniken, Mark Cieliebak
Abstract
Transliteration is the process of expressing a proper name from a source language in the characters of a target language (e.g. from Cyrillic to Latin characters). We present TRANSLIT, a large-scale corpus with approx. 1.6 million entries in more than 180 languages with about 3 million variations of person and geolocation names. The corpus is based on various public data sources, which have been transformed into a unified format to simplify their usage, plus a newly compiled dataset from Wikipedia. In addition, we apply several machine learning methods to establish baselines for automatically detecting transliterated names in various languages. Our best systems achieve an accuracy of 92% on identification of transliterated pairs.- Anthology ID:
- 2020.lrec-1.399
- Volume:
- Proceedings of the Twelfth Language Resources and Evaluation Conference
- Month:
- May
- Year:
- 2020
- Address:
- Marseille, France
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association
- Note:
- Pages:
- 3265–3271
- Language:
- English
- URL:
- https://aclanthology.org/2020.lrec-1.399
- DOI:
- Cite (ACL):
- Fernando Benites, Gilbert François Duivesteijn, Pius von Däniken, and Mark Cieliebak. 2020. TRANSLIT: A Large-scale Name Transliteration Resource. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 3265–3271, Marseille, France. European Language Resources Association.
- Cite (Informal):
- TRANSLIT: A Large-scale Name Transliteration Resource (Benites et al., LREC 2020)
- PDF:
- https://preview.aclanthology.org/nodalida-main-page/2020.lrec-1.399.pdf