Rasende Rakete at SemEval-2026 Task 6: LLM-First Approach with Iterative Prompt Repair for Classifying Evasion in Political Interviews
Omar Elbeltagui, Nils Knittel, Leonie Süß, Umut Yıldırır, Qiyan Zhai, Shaghayegh Kolli, Jana Diesner
Abstract
We describe our system for SemEval-2026 Task 6 (CLARITY), which addresses automatic detection of evasive responses in political interviews. We adopt an LLM-first approach built around two core contributions: (i) an iterative prompt repair loop that diagnoses classification errors on concrete failure examples and applies prompt revisions and (ii) a configurable end-to-end Java Pipeline that supports multiple LLM providers, strategies, and systematic experimentation.- Anthology ID:
- 2026.semeval-1.280
- Volume:
- Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
- Venues:
- SemEval | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2216–2227
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.280/
- DOI:
- Cite (ACL):
- Omar Elbeltagui, Nils Knittel, Leonie Süß, Umut Yıldırır, Qiyan Zhai, Shaghayegh Kolli, and Jana Diesner. 2026. Rasende Rakete at SemEval-2026 Task 6: LLM-First Approach with Iterative Prompt Repair for Classifying Evasion in Political Interviews. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2216–2227, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- Rasende Rakete at SemEval-2026 Task 6: LLM-First Approach with Iterative Prompt Repair for Classifying Evasion in Political Interviews (Elbeltagui et al., SemEval 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.280.pdf