Sentiment Syndicate at SemEval-2026 Task 6: Reframing Political Question–Answer Interactions via Natural Language Inference for Clarity Level Classification

Rafi Rafsan


Abstract
This paper presents the Sentiment Syndicate team’s submission to SemEval-2026 Task 6, Subtask 1 (CLARITY: Unmasking Political Question Evasions), which focuses on classifying the clarity level of political question–answer interactions. We investigate three modeling strategies: (1) fine-tuning a RoBERTa-based classifier, (2) reformulating the task as a Natural Language Inference (NLI) problem, and (3) leveraging large language models (LLMs) for classification. All approaches are evaluated using macro F1-score on the official dataset. Experimental results demonstrate that the NLI based formulation outperforms the other strategies, highlighting the effectiveness of modeling semantic alignment between questions and answers. Our best-performing system achieves an F1-score of 0.67 on the test set.
Anthology ID:
2026.semeval-1.350
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2779–2786
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.350/
DOI:
Bibkey:
Cite (ACL):
Rafi Rafsan. 2026. Sentiment Syndicate at SemEval-2026 Task 6: Reframing Political Question–Answer Interactions via Natural Language Inference for Clarity Level Classification. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2779–2786, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Sentiment Syndicate at SemEval-2026 Task 6: Reframing Political Question–Answer Interactions via Natural Language Inference for Clarity Level Classification (Rafsan, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.350.pdf
Supplementarymaterial:
 2026.semeval-1.350.SupplementaryMaterial.zip