SigJBS@LT-EDI 2026: QLoRA-Tuned Homophobic and Transphobic Counter Narrative Generation
Gaurangi Sinha, Rajarajeswari Palacharla, Manoj Balaji Jagadeeshan
Abstract
We present our approach to LT-EDI@ACL 2026 on counter-narrative generation for homophobic and transphobic comments. Generating high-quality counter-narratives in multilingual and low-resource settings remains challenging, particularly when data imbalance and script variation affect model performance. To address these issues, we explore multiple modeling strategies built around Gemma 3 12B with QLoRA fine-tuning, including data rebalancing and alternative input strategies for Tamil. Our findings show that task-specific fine-tuning combined with native-script Tamil produces more stable and higher-quality outputs than large few-shot prompts or transliteration-basedinputs. On the official leaderboard, our system ranks second in English with an overall score of 86.35% and sixth in Tamil with 63.77%,highlighting both the effectiveness of targeted fine-tuning and the challenges of low-resource counter-narrative generation.- Anthology ID:
- 2026.ltedi-1.29
- Volume:
- Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion
- Month:
- July
- Year:
- 2026
- Address:
- Virtual (Online)
- Editors:
- Bharathi Raja Chakravarthi, Bharathi B, Paul Buitelaar, Durairaj Thenmozhi, Miguel Ángel García Cumbreras, Salud María Jiménez Zafra
- Venues:
- LTEDI | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 234–238
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.ltedi-1.29/
- DOI:
- Cite (ACL):
- Gaurangi Sinha, Rajarajeswari Palacharla, and Manoj Balaji Jagadeeshan. 2026. SigJBS@LT-EDI 2026: QLoRA-Tuned Homophobic and Transphobic Counter Narrative Generation. In Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion, pages 234–238, Virtual (Online). Association for Computational Linguistics.
- Cite (Informal):
- SigJBS@LT-EDI 2026: QLoRA-Tuned Homophobic and Transphobic Counter Narrative Generation (Sinha et al., LTEDI 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.ltedi-1.29.pdf