Team Evaluators at SemEval-2026 Task 6: Instruction-Tuned LLMs for Clarity and Evasion Classification in Political Interviews

Siva Nuthakki, Sanjay Pulagam, Sai Woona


Abstract
This work is part of the SemEval-2026 CLARITY shared task (Task 6), which focuses on detecting clarity and evasion in political question–answer pairs from interviews and debates. The competition includes two subtasks: clarity-level classification (Clear Reply, Ambiguous,Clear Non-Reply) and evasion-level classification, which identifies one of nine fine-grained evasion techniques. The dataset consists of annotated question–answer pairs with hierarchical labels for both clarity and evasion, enabling comprehensive evaluation of nuanced discoursephenomena. We fine-tune open-source large language models using Low-Rank Adaptation (LoRA) and supervised fine-tuning (SFT), employing structured prompts that jointly encode the question and answer to capture discoursecues. Models are evaluated using Macro F1, the official metric of the shared task. Our system achieves a Macro F1 of 0.83 on Subtask 1 (5th place) and 0.54 on Subtask 2 (9th place), demonstrating that parameter-efficient fine-tuning of LLMs is effective for modeling strategic ambiguity in political discourse.
Anthology ID:
2026.semeval-1.426
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3442–3445
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.426/
DOI:
Bibkey:
Cite (ACL):
Siva Nuthakki, Sanjay Pulagam, and Sai Woona. 2026. Team Evaluators at SemEval-2026 Task 6: Instruction-Tuned LLMs for Clarity and Evasion Classification in Political Interviews. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 3442–3445, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Team Evaluators at SemEval-2026 Task 6: Instruction-Tuned LLMs for Clarity and Evasion Classification in Political Interviews (Nuthakki et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.426.pdf