PolaFusion at SemEval-2026 Task 9: Ensemble Transformers with Targeted Augmentation for Multilingual Polarization Detection

Abdullah Mohammad


Abstract
We present PolaFusion, our system for SemEval-2026 Task 9, which requires detecting polarization in social media posts across 22 languages, classifying its type (Subtask 2), and identifying its rhetorical manifestation (Subtask 3). The task is characterized by severe and pervasive class imbalance across all three subtasks and all 22 languages. We address this through a combination of three strategies: a hierarchical gating architecture where a binary gatekeeper model gates two specialist classifiers trained exclusively on polarized content; an eight-model mega-ensemble combining fivefold mDeBERTa-v3-base and three-fold XLM-RoBERTa-large with soft-vote probability aggregation; and a Macro-F1-aware augmentation strategy using Qwen3-235B that generates synthetic minority-class examples only for language-label pairs that are both scarce and poorly learned. Throughout training, inverse-frequency class weighting within BCEWithLogitsLoss forces the model to attend proportionally to rare labels. Our system achieves official Macro-F1 scores of 0.800, 0.576, and 0.502 on Subtasks 1–3 respectively, outperforming the POLAR baseline by +0.040, +0.089, and +0.082 average Macro-F1 across languages. Our code is publicly available at https://github.com/Abdullah4152/PolaFuse.
Anthology ID:
2026.semeval-1.361
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2877–2885
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.361/
DOI:
Bibkey:
Cite (ACL):
Abdullah Mohammad. 2026. PolaFusion at SemEval-2026 Task 9: Ensemble Transformers with Targeted Augmentation for Multilingual Polarization Detection. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2877–2885, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
PolaFusion at SemEval-2026 Task 9: Ensemble Transformers with Targeted Augmentation for Multilingual Polarization Detection (Mohammad, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.361.pdf
Supplementarymaterial:
 2026.semeval-1.361.SupplementaryMaterial.zip