Can Stories Help LLMs Reason? Curating Information Space Through Narrative
Vahid Sadiri Javadi, Johanne Trippas, Yash Kumar Lal, Lucie Flek
Abstract
Narratives are widely recognized as a powerful tool for structuring information and facilitating comprehension of complex ideas in various domains such as science communication. This paper explores whether generating narratives can serve “as a specialized mode of thinking” that improves the reasoning abilities of Large Language Models (LLMs). We introduce Story of Thought (SoT), a novel prompt-driven reasoning framework that guides LLMs to construct narratives around the problem statement to solve the task more effectively. SoT enables LLMs to integrate narrative techniques such as metaphor and analogy into their reasoning process. Our experiments show that SoT significantly improves the LLMs’ problem-solving abilities on various tasks, including physics, chemistry, and biology in both JEEBench and GPQA (e.g., SoT resulted in 13% improvement compared to CoT when using GPT-4). To validate LLM-based evaluation for generated narratives, we conduct a human annotation of the narrative techniques used by LLMs. Our results show strong inter-annotator agreement between Llama 3 70B and human annotators. This work brings LLM reasoning closer to human cognitive processes by mirroring mechanisms such as analogical problem-solving, which are central to how humans understand and process complex ideas.- Anthology ID:
- 2025.analogyangle-1.8
- Volume:
- Proceedings of the 2nd Workshop on Analogical Abstraction in Cognition, Perception, and Language (Analogy-Angle II)
- Month:
- August
- Year:
- 2025
- Address:
- Vienna, Austria
- Editors:
- Giulia Rambelli, Filip Ilievski, Marianna Bolognesi, Pia Sommerauer
- Venues:
- Analogy-Angle | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 92–107
- Language:
- URL:
- https://preview.aclanthology.org/acl25-workshop-ingestion/2025.analogyangle-1.8/
- DOI:
- Cite (ACL):
- Vahid Sadiri Javadi, Johanne Trippas, Yash Kumar Lal, and Lucie Flek. 2025. Can Stories Help LLMs Reason? Curating Information Space Through Narrative. In Proceedings of the 2nd Workshop on Analogical Abstraction in Cognition, Perception, and Language (Analogy-Angle II), pages 92–107, Vienna, Austria. Association for Computational Linguistics.
- Cite (Informal):
- Can Stories Help LLMs Reason? Curating Information Space Through Narrative (Sadiri Javadi et al., Analogy-Angle 2025)
- PDF:
- https://preview.aclanthology.org/acl25-workshop-ingestion/2025.analogyangle-1.8.pdf