Team INSALyon2 at SemEval-2025 Task 10: A Zero-shot Agentic Approach to Text Classification

Mohamed - Nour Eljadiri, Diana Nurbakova


Abstract
We present Team INSALyon2’s agentic approach to SemEval-2025 Task 10 Subtask 2, which focuses on the multi-label classification of narratives in news articles across five languages. Our system employs a zero-shot architecture where specialized Large Language Model (LLM) agents handle binary classification tasks for individual narrative/subnarrative labels, with a meta-agent aggregating these decisions into final multi-label predictions. Instead of fine-tuning on the dataset, we leverage AutoGen to orchestrate multiple GPT-based agents, each responsible for detecting specific narrative/subnarrative types in a modular framework. This agent-based approach naturally handles the challenge of multi-label classification by enabling parallel decisions across the two-level taxonomy. Experiments on the English subset demonstrate strong performance with our system achieving F1_macro_coarse = 0.513, F1_sample = 0.406, securing third place in the competition. Our findings show that zero-shot agentic approaches can be competitive in complex classification tasks.
Anthology ID:
2025.semeval-1.129
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
965–980
Language:
URL:
https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.129/
DOI:
Bibkey:
Cite (ACL):
Mohamed - Nour Eljadiri and Diana Nurbakova. 2025. Team INSALyon2 at SemEval-2025 Task 10: A Zero-shot Agentic Approach to Text Classification. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 965–980, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Team INSALyon2 at SemEval-2025 Task 10: A Zero-shot Agentic Approach to Text Classification (Eljadiri & Nurbakova, SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.129.pdf