asetclarity at SemEval-2026 Task 6: An Imbalance-Aware RoBERTa Cross-Encoder for Political Response Clarity Classification

Maria-Antonia-Emanuela Pascu, Dan Dodun-des-Perrieres, Daniela Gifu


Abstract
We address response-clarity classification in political interviews as defined in SemEval-2026 Task 6: CLARITY - Unmasking Political Question Evasions, Task 1, where systems must label each question–answer pair as Clear Reply, Ambivalent, or Clear Non-Reply. We present a reproducible end-to-end pipeline built around a single-stream RoBERTa-large cross-encoder fine-tuned for three-way classification using deterministic text normalization, concatenated QA inputs, and imbalance-aware training (minority oversampling and class-weighted loss). To improve robustness, we train a 5-fold stratified ensemble and combine models via soft-voting. Our official shared-task submission obtains 0.76 macro-F1 on the official leaderboard, ranking 16 out of 41 participating systems. Finally, we deploy the classifier in a lightweight web application supporting both direct text input and audio-based analysis through automatic transcription, enabling interactive inspection of predicted clarity categories.
Anthology ID:
2026.semeval-1.146
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1068–1074
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.146/
DOI:
Bibkey:
Cite (ACL):
Maria-Antonia-Emanuela Pascu, Dan Dodun-des-Perrieres, and Daniela Gifu. 2026. asetclarity at SemEval-2026 Task 6: An Imbalance-Aware RoBERTa Cross-Encoder for Political Response Clarity Classification. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 1068–1074, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
asetclarity at SemEval-2026 Task 6: An Imbalance-Aware RoBERTa Cross-Encoder for Political Response Clarity Classification (Pascu et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.146.pdf
Supplementarymaterial:
 2026.semeval-1.146.SupplementaryMaterial.zip