LingoResearchGroup at SemEval-2026 Task 9: Evaluating Prompt Variants for Polarization Detection

Pritam Kadasi, Anuj Tiwari, Mayank Singh


Abstract
Our submission presented in this paper is for SemEval-2026 Task 9: Multilingual Text Classification Challenge - Polarization Detection and it covers all three subtasks: (1) binary polarization detection, (2) polarization type classification and (3) polarization manifestation identification. We adopt a systematic approach of research on short designed prompts by considering twelve designed prompts that are different in terminology clarity, detail of the definition, guidance of reasoning and in-context examples use. The experiments are conducted using aya-101 and Gemma3-27B, with the latter chosen for the submission at the end of the development through performance considerations. Our system has an average macro level \textbf{F1-score of 0.762 on Subtask 1, 0.587 on Subtask 2 and 0.444 on Subtask 3} with the average accuracy of 0.819, 0.678 and 0.498, respectively, on the official test set averaged among 22 languages, respectively. With cross-task and cross-lingual analysis, we demonstrate that prompt-based approaches can be used effectively to detect coarse-grained polarization but encounter more and more difficulties as far as fine-grained and multi-label sociolinguistic classification is concerned.
Anthology ID:
2026.semeval-1.376
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2991–3001
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.376/
DOI:
Bibkey:
Cite (ACL):
Pritam Kadasi, Anuj Tiwari, and Mayank Singh. 2026. LingoResearchGroup at SemEval-2026 Task 9: Evaluating Prompt Variants for Polarization Detection. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2991–3001, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
LingoResearchGroup at SemEval-2026 Task 9: Evaluating Prompt Variants for Polarization Detection (Kadasi et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.376.pdf
Supplementarymaterial:
 2026.semeval-1.376.SupplementaryMaterial.zip