ttda704 at SemEval-2026 Task 6: Structured Chain-of-Thought Prompting for Political Evasion Detection

Tai Tran Tan, An Dinh


Abstract
We present our system for SemEval-2026 Task 6 (CLARITY: Unmasking Political Question Evasions), which addresses political evasion detection in English question-answer pairs from U.S. presidential interviews.We compare two paradigms: (1) parameter-efficient fine-tuning of Qwen3 models (4B–32B) using QLoRA with tiered upsampling and weighted cross-entropy loss to address severe class imbalance, and (2) structured Chain-of-Thought (CoT) prompting with reasoning-capable API models, including DeepSeek-V3.2 and Grok-4-Fast.Our best system uses Grok-4-Fast with extended reasoning and few-shot hierarchical CoT prompting, achieving Macro F1 scores of 0.5147 on Subtask 2 (9-class evasion) and 0.7979 on Subtask 1 (3-class clarity). On the official leaderboard, it ranks 8/33 on Subtask 2 and 13/41 on Subtask 1. Ablation results show that hierarchical label presentation provides a useful reasoning scaffold and that extended reasoning helps models handle subtle pragmatic distinctions, although the strongest prompt variants are not statistically distinguishable in Macro F1.
Anthology ID:
2026.semeval-1.355
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2817–2829
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.355/
DOI:
Bibkey:
Cite (ACL):
Tai Tran Tan and An Dinh. 2026. ttda704 at SemEval-2026 Task 6: Structured Chain-of-Thought Prompting for Political Evasion Detection. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2817–2829, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
ttda704 at SemEval-2026 Task 6: Structured Chain-of-Thought Prompting for Political Evasion Detection (Tran Tan & Dinh, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.355.pdf
Supplementarymaterial:
 2026.semeval-1.355.SupplementaryMaterial.zip
Supplementarymaterial:
 2026.semeval-1.355.SupplementaryMaterial.zip