NIT-Agartala-NLP-Team at SemEval-2026 Task 9: A Weighted Soft-Voting Ensemble Framework of Fine-Tuned LLMs for Binary and Multi-Label Polarization Detection

Shivam, Manish Kumar, Anupam Jamatia


Abstract
This paper presents the NIT-Agartala-NLPTeam’s submission to SemEval-2026 Task 9on polarization detection in textual data. Thetask comprises two subtasks: (i) binary classification to distinguish polarized from nonpolarized content, and (ii) multi-label classification to identify the specific type(s) of polarization. We propose a weighted soft-votingensemble framework that integrates multiplefine-tuned large language models (LLMs). Theprobabilistic outputs of the individual models are combined using weighted averagingto effectively leverage their complementarystrengths and enhance overall performance.Our system achieved a test macro F1-score of78.6 (26th out of 44 teams) in Subtask 1 and46.0 (18th out of 29 teams) in Subtask 2.
Anthology ID:
2026.semeval-1.398
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3169–3181
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.398/
DOI:
Bibkey:
Cite (ACL):
Shivam, Manish Kumar, and Anupam Jamatia. 2026. NIT-Agartala-NLP-Team at SemEval-2026 Task 9: A Weighted Soft-Voting Ensemble Framework of Fine-Tuned LLMs for Binary and Multi-Label Polarization Detection. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 3169–3181, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
NIT-Agartala-NLP-Team at SemEval-2026 Task 9: A Weighted Soft-Voting Ensemble Framework of Fine-Tuned LLMs for Binary and Multi-Label Polarization Detection (Shivam et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.398.pdf
Supplementarymaterial:
 2026.semeval-1.398.SupplementaryMaterial.zip