Choiru Firdaus
2026
AI@UMS at SemEval-2026 Task 6: Handling Long Question-Answer Pairs with Sliding Window Models for Clarity and Evasion Analysis
Ikhlasul Amal | Zia Ul Zafar | Choiru Firdaus | Endang Pamungkas
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Ikhlasul Amal | Zia Ul Zafar | Choiru Firdaus | Endang Pamungkas
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
This paper presents the AI@UMS system for SemEval-2026 Task 6: CLARITY - Unmasking Political Question Evasions. The task requires classifying question-answer (QA) pairs from political interviews along two dimensions: clarity level (Subtask 1) and evasion technique (Subtask 2). A key challenge is that political interview transcripts often exceed the 512-token input limit of standard transformer encoder models. We address this with a sliding-window fine-tuning strategy applied to roberta-base, where each QA pair is segmented into overlapping windows of 512 tokens with a stride of 256 tokens. Per-window predictions are aggregated via softmax probability averaging across multiple windows and across an ensemble of three independently trained models with different random seeds. We further employ class-weighted focal-inspired loss and label smoothing to mitigate the pronounced class imbalance in both subtasks. Our system achieves macro F1 scores of 0.62 (Subtask 1) and 0.48 (Subtask 2) on the official evaluation set.