Seals-NLP at SemEval-2026 Task 9: A Comparative Study of Transformer Architectures for Polarization Detection

Minh Smith, Cheryl Seals


Abstract
We describe the Seals-NLP system for SemEval-2026 Task 9 (POLAR) Subtask 1, binary polarization detection. Our study compares (i) fully fine-tuned encoder-only transformers, (ii) QLoRA-based fine-tuned open-weight LLMs, and (iii) zero-shot prompted LLMs. ModernBERT-large emerges as the most cost-effective option, matching or surpassing larger fine-tuned and zero-shot LLMs in macro-F1 while requiring substantially less memory and lower latency. An error analysis by failure mode and polarization subtype reveals systematic over-triggering on political cue words and under-detection of sarcastic vilification and multifaceted attacks in the POLAR dataset across all models.
Anthology ID:
2026.semeval-1.301
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2394–2401
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.301/
DOI:
Bibkey:
Cite (ACL):
Minh Smith and Cheryl Seals. 2026. Seals-NLP at SemEval-2026 Task 9: A Comparative Study of Transformer Architectures for Polarization Detection. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2394–2401, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Seals-NLP at SemEval-2026 Task 9: A Comparative Study of Transformer Architectures for Polarization Detection (Smith & Seals, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.301.pdf
Supplementarymaterial:
 2026.semeval-1.301.SupplementaryMaterial.zip