ILab-NLP at SemEval-2026 Task 9: Comparing XLM-RoBERTa and LLaMA-2 for Multilingual Polarization Detection

Declan Booth, Gavin Abercrombie, Simona Frenda


Abstract
This submission describes a system for SemEval-2026 Task 9, Subtask 1, focused on binary detection of polarized versus non-polarized posts in English and Spanish. We compare two approaches: a fine-tuned multilingual encoder model (XLM-RoBERTa) and a prompted generative model (LLaMA-2 7B). Our experiments show that XLM-RoBERTa delivers stronger and more stable performance overall, while LLaMA-2 is more prone to false positives in Spanish due to a strong bias toward predicting the polarized class. In addition to headline results, we analyse model behaviour using confidence signals and SHAP, and report efficiency measurements with CodeCarbon to highlight practical tradeoffs between performance and computational cost.
Anthology ID:
2026.semeval-1.189
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1462–1468
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.189/
DOI:
Bibkey:
Cite (ACL):
Declan Booth, Gavin Abercrombie, and Simona Frenda. 2026. ILab-NLP at SemEval-2026 Task 9: Comparing XLM-RoBERTa and LLaMA-2 for Multilingual Polarization Detection. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 1462–1468, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
ILab-NLP at SemEval-2026 Task 9: Comparing XLM-RoBERTa and LLaMA-2 for Multilingual Polarization Detection (Booth et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.189.pdf
Supplementarymaterial:
 2026.semeval-1.189.SupplementaryMaterial.zip
Supplementarymaterial:
 2026.semeval-1.189.SupplementaryMaterial.zip