Rasende Rakete at SemEval-2026 Task 6: LLM-First Approach with Iterative Prompt Repair for Classifying Evasion in Political Interviews

Omar Elbeltagui, Nils Knittel, Leonie Süß, Umut Yıldırır, Qiyan Zhai, Shaghayegh Kolli, Jana Diesner


Abstract
We describe our system for SemEval-2026 Task 6 (CLARITY), which addresses automatic detection of evasive responses in political interviews. We adopt an LLM-first approach built around two core contributions: (i) an iterative prompt repair loop that diagnoses classification errors on concrete failure examples and applies prompt revisions and (ii) a configurable end-to-end Java Pipeline that supports multiple LLM providers, strategies, and systematic experimentation.
Anthology ID:
2026.semeval-1.280
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2216–2227
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.280/
DOI:
Bibkey:
Cite (ACL):
Omar Elbeltagui, Nils Knittel, Leonie Süß, Umut Yıldırır, Qiyan Zhai, Shaghayegh Kolli, and Jana Diesner. 2026. Rasende Rakete at SemEval-2026 Task 6: LLM-First Approach with Iterative Prompt Repair for Classifying Evasion in Political Interviews. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2216–2227, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Rasende Rakete at SemEval-2026 Task 6: LLM-First Approach with Iterative Prompt Repair for Classifying Evasion in Political Interviews (Elbeltagui et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.280.pdf