FormosanMT: A Multilingual Parallel Corpus of the Formosan Language Family
Hunter Scheppat, Joshua K. Hartshorne, Sema Koc, Éric Le Ferrand, Emily Prud’hommeaux
Abstract
While the quality of machine translation (MT) between widely-spoken languages has improved dramatically in recent years, training robust MT systems for languages with fewer resources remains a challenge. Endangered languages, which often lack the speaker population and written tradition needed to create text resources, are at a particular disadvantage. Developing robust MT architectures for very low-resource settings is hampered by the lack of suitable parallel corpora. To address this challenge, we introduce FormosanMT, a set of MT-ready parallel corpora for the Formosan family of endangered languages indigenous to Taiwan. Together the corpora total nearly 500,000 Formosan-Mandarin and Formosan-English sentence pairs. We share scripts for extracting these corpora from public sources, along with customizable tools for filtering, normalizing, and partitioning the data. In addition, we provide a new tokenizer for Traditional Chinese writing compatible with the popular No Language Left Behind (NLLB) MT architecture, along with updated and improved code for fine-tuning NLLB for any low-resource language pair. Finally we distribute our fully trained NLLB and OpenNMT models for the Formosan languages to and from both Mandarin and English. In addition to serving as a valuable resource for the Formosan language speaker communities, our data, code, and models will be available to NLP researchers working on endangered and low-resource language MT.- Anthology ID:
- 2026.lrec-1.273
- Volume:
- Proceedings of the Fifteenth Language Resources and Evaluation Conference
- Month:
- May
- Year:
- 2026
- Address:
- Palma de Mallorca, Spain
- Editors:
- Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
- Venue:
- LREC
- SIG:
- Publisher:
- ELRA Language Resource Association
- Note:
- Pages:
- 3445–3455
- Language:
- External URL:
- https://lrec.elra.info/lrec2026-main-273
- DOI:
- 10.63317/3ut33xim33nt
- Cite (ACL):
- Hunter Scheppat, Joshua K. Hartshorne, Sema Koc, Éric Le Ferrand, and Emily Prud’hommeaux. 2026. FormosanMT: A Multilingual Parallel Corpus of the Formosan Language Family. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 3445–3455, Palma de Mallorca, Spain. ELRA Language Resource Association.
- Cite (Informal):
- FormosanMT: A Multilingual Parallel Corpus of the Formosan Language Family (Scheppat et al., LREC 2026)