Fane at SemEval-2025 Task 10: Zero-Shot Entity Framing with Large Language Models

Enfa Fane, Mihai Surdeanu, Eduardo Blanco, Steven Corman


Abstract
Understanding how news narratives frame entities is crucial for studying media’s impact on societal perceptions of events. In this paper, we evaluate the zero-shot capabilities of large language models (LLMs) in classifying framing roles. Through systematic experimentation, we assess the effects of input context, prompting strategies, and task decomposition. Our findings show that a hierarchical approach of first identifying broad roles and then fine-grained roles, outperforms single-step classification. We also demonstrate that optimal input contexts and prompts vary across task levels, highlighting the need for subtask-specific strategies. We achieve a Main Role Accuracy of 89.4% and an Exact Match Ratio of 34.5%, demonstrating the effectiveness of our approach. Our findings emphasize the importance of tailored prompt design and input context optimization for improving LLM performance in entity framing.
Anthology ID:
2025.semeval-1.251
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1924–1934
Language:
URL:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.251/
DOI:
Bibkey:
Cite (ACL):
Enfa Fane, Mihai Surdeanu, Eduardo Blanco, and Steven Corman. 2025. Fane at SemEval-2025 Task 10: Zero-Shot Entity Framing with Large Language Models. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 1924–1934, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Fane at SemEval-2025 Task 10: Zero-Shot Entity Framing with Large Language Models (Fane et al., SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.251.pdf