Findings of the MMLoSo 2025 Shared Task on Machine Translation into Tribal Languages

Pooja Singh, Sandeep Chatterjee, Gullal S. Cheema, Amrit Singh Bedi, Tanmoy Chakraborty, Sandeep Kumar, Ankita Shukla


Abstract
This paper presents the findings of the MMLoSo Shared Task on Machine Translation. The competition features four tribal languages from India: Bhili, Mundari, Gondi, and Santali, each with 20,000 high-quality parallel sentence pairs and a 16,000-sentence evaluation set. A total of 18 teams submitted across all language pairs. The shared task addresses the challenges of translating India’s severely low-resource tribal languages, which, despite having millions of speakers, remain digitally marginalized due to limited textual resources, diverse scripts, rich morphology, and minimal publicly available parallel corpora. Systems were ranked using a weighted composite score combining BLEU (60%) and chrF (40%) to balance structural accuracy and character-level fluency. The best-performing system leveraged IndicTrans2 with directional LoRA adapters and reverse-model reranking. This work establishes the first reproducible benchmark for machine translation in these tribal languages. All datasets, baseline models, and system outputs are publicly released to support continued research in India’s tribal language technologies.
Anthology ID:
2025.mmloso-1.14
Volume:
Proceedings of the 1st Workshop on Multimodal Models for Low-Resource Contexts and Social Impact (MMLoSo 2025)
Month:
December
Year:
2025
Address:
Mumbai, India
Editors:
Ankita Shukla, Sandeep Kumar, Amrit Singh Bedi, Tanmoy Chakraborty
Venues:
MMLoSo | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
121–129
Language:
URL:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.mmloso-1.14/
DOI:
Bibkey:
Cite (ACL):
Pooja Singh, Sandeep Chatterjee, Gullal S. Cheema, Amrit Singh Bedi, Tanmoy Chakraborty, Sandeep Kumar, and Ankita Shukla. 2025. Findings of the MMLoSo 2025 Shared Task on Machine Translation into Tribal Languages. In Proceedings of the 1st Workshop on Multimodal Models for Low-Resource Contexts and Social Impact (MMLoSo 2025), pages 121–129, Mumbai, India. Association for Computational Linguistics.
Cite (Informal):
Findings of the MMLoSo 2025 Shared Task on Machine Translation into Tribal Languages (Singh et al., MMLoSo 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.mmloso-1.14.pdf