FER at SemEval-2026 Task 6: Analysis of Different Approaches to Unmasking Political Question Evasions

Matija Akrap, Andrija Bilić, Roko Šimpraga, Fran Račić, Luka Čuturilo


Abstract
We tackle classifying evasive political answerswithin the context of SemEval-2026 Task 6 andcompare three modeling strategies: a flat base-line, a hierarchical cascade, and a multitasklearning approach. Our experiments demon-strate that a hierarchical RoBERTa-base modelachieves the best performance, particularly byleveraging the distinctiveness of the class ClearNon-Reply. Conversely, we find that stan-dard multitask learning frequently producesstructurally invalid label combinations in a sig-nificant fraction of predictions. Our demon-strations show that applying a constrained in-ference mask eliminates these errors entirelywhile improving F1 performance, whereas afully joint training approach underperforms dueto data sparsity. Finally, we employ datasetcartography to compare training dynamics be-tween the hierarchical and multitask approach.
Anthology ID:
2026.semeval-1.5
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
30–36
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.5/
DOI:
Bibkey:
Cite (ACL):
Matija Akrap, Andrija Bilić, Roko Šimpraga, Fran Račić, and Luka Čuturilo. 2026. FER at SemEval-2026 Task 6: Analysis of Different Approaches to Unmasking Political Question Evasions. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 30–36, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
FER at SemEval-2026 Task 6: Analysis of Different Approaches to Unmasking Political Question Evasions (Akrap et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.5.pdf
Supplementarymaterial:
 2026.semeval-1.5.SupplementaryMaterial.zip