FER at SemEval-2026 Task 6: Analysis of Different Approaches to Unmasking Political Question Evasions
Matija Akrap, Andrija Bilić, Roko Šimpraga, Fran Račić, Luka Čuturilo
Abstract
We tackle classifying evasive political answerswithin the context of SemEval-2026 Task 6 andcompare three modeling strategies: a flat base-line, a hierarchical cascade, and a multitasklearning approach. Our experiments demon-strate that a hierarchical RoBERTa-base modelachieves the best performance, particularly byleveraging the distinctiveness of the class ClearNon-Reply. Conversely, we find that stan-dard multitask learning frequently producesstructurally invalid label combinations in a sig-nificant fraction of predictions. Our demon-strations show that applying a constrained in-ference mask eliminates these errors entirelywhile improving F1 performance, whereas afully joint training approach underperforms dueto data sparsity. Finally, we employ datasetcartography to compare training dynamics be-tween the hierarchical and multitask approach.- Anthology ID:
- 2026.semeval-1.5
- Volume:
- Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
- Venues:
- SemEval | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 30–36
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.5/
- DOI:
- Cite (ACL):
- Matija Akrap, Andrija Bilić, Roko Šimpraga, Fran Račić, and Luka Čuturilo. 2026. FER at SemEval-2026 Task 6: Analysis of Different Approaches to Unmasking Political Question Evasions. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 30–36, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- FER at SemEval-2026 Task 6: Analysis of Different Approaches to Unmasking Political Question Evasions (Akrap et al., SemEval 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.5.pdf