Findings of the IndicGEC and IndicWG Shared Task at BHASHA 2025

Pramit Bhattacharyya, Karthika N J, Hrishikesh Terdalkar, Manoj Balaji Jagadeeshan, Shubham Kumar Nigam, Arvapalli Sai Susmitha, Arnab Bhattacharya


Abstract
This overview paper presents the findings of the two shared tasks organized as part of the 1st Workshop on Benchmarks, Harmonization, Annotation, and Standardization for Human-Centric AI in Indian Languages (BHASHA) co-located with IJCNLP-AACL 2025. The shared tasks are: (1) Indic Grammar Error Correction (IndicGEC) and (2) Indic Word Grouping (IndicWG). For GEC, participants were tasked with producing grammatically correct sentences based on given input sentences in five Indian languages. For WG, participants were required to generate a word-grouped variant of a provided sentence in Hindi. The evaluation metric used for GEC was GLEU, while Exact Matching was employed for WG. A total of 14 teams participated in the final phase of the Shared Task 1; 2 teams participated in the final phase of Shared Task 2. The maximum GLEU scores obtained for Hindi, Bangla, Telugu, Tamil and Malayalam languages are respectively 85.69, 95.79, 88.17, 91.57 and 96.02 for the IndicGEC shared task. The highest exact matching score obtained for IndicWG shared task is 45.13%.
Anthology ID:
2025.bhasha-1.12
Volume:
Proceedings of the 1st Workshop on Benchmarks, Harmonization, Annotation, and Standardization for Human-Centric AI in Indian Languages (BHASHA 2025)
Month:
December
Year:
2025
Address:
Mumbai, India
Editors:
Arnab Bhattacharya, Pawan Goyal, Saptarshi Ghosh, Kripabandhu Ghosh
Venues:
BHASHA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
127–134
Language:
URL:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.bhasha-1.12/
DOI:
Bibkey:
Cite (ACL):
Pramit Bhattacharyya, Karthika N J, Hrishikesh Terdalkar, Manoj Balaji Jagadeeshan, Shubham Kumar Nigam, Arvapalli Sai Susmitha, and Arnab Bhattacharya. 2025. Findings of the IndicGEC and IndicWG Shared Task at BHASHA 2025. In Proceedings of the 1st Workshop on Benchmarks, Harmonization, Annotation, and Standardization for Human-Centric AI in Indian Languages (BHASHA 2025), pages 127–134, Mumbai, India. Association for Computational Linguistics.
Cite (Informal):
Findings of the IndicGEC and IndicWG Shared Task at BHASHA 2025 (Bhattacharyya et al., BHASHA 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.bhasha-1.12.pdf