B B at SemEval-2026 Task 6: A RoBERTa-based Model with NLI-derived Semantic Features for Clarity-Level Classification of Political Question Evasion

Chi-Bo Lin, Boyang Yu


Abstract
Equivocation and ambiguity are common in political interviews, where public figures often avoid directly answering challenging questions. We present our submission to SemEval-2026 Task 6, Subtask 1 on English political response clarity classification. Our system builds on RoBERTa and incorporates NLI-derived semantic features to distinguish Clear Reply, Ambivalent, and Clear Non-Reply responses. To address class imbalance and performance instability, we explore class weighting, multi-seed ensembling, and a hierarchical two-stage framework with threshold tuning. Our best model achieves 60% macro-F1 on the official test set and 64% macro-F1 on an additional evaluation set, demonstrating stable performance across splits. Our results show that carefully engineered smaller models, combined with structured semantic features and imbalance-aware training, provide an effective and computationally efficient solution under limited training data.
Anthology ID:
2026.semeval-1.384
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3060–3067
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.384/
DOI:
Bibkey:
Cite (ACL):
Chi-Bo Lin and Boyang Yu. 2026. B B at SemEval-2026 Task 6: A RoBERTa-based Model with NLI-derived Semantic Features for Clarity-Level Classification of Political Question Evasion. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 3060–3067, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
B B at SemEval-2026 Task 6: A RoBERTa-based Model with NLI-derived Semantic Features for Clarity-Level Classification of Political Question Evasion (Lin & Yu, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.384.pdf
Supplementarymaterial:
 2026.semeval-1.384.SupplementaryMaterial.zip