Creative Planning with Language Models: Practice, Evaluation and Applications
Alexander Spangher, Tenghao Huang, Philippe Laban, Nanyun Peng
Abstract
The use of large language models (LLMs) in human-centered creative tasks — such as journalism, scientific writing, and storytelling — has showcased their potential for content generation but highlighted a critical gap: planning. Planning, used here to describe the “actions” humans perform before (and during) the writing process, is a fundamental process in many creative domains. This tutorial explores how planning has been learned and deployed in creative workflows, unifying three scenarios: Full Data Regimens (when observational data for actions and the resulting text exist), Partial (when text exists but actions can be inferred) and Low (when neither exist). The tutorial discusses forward and backward learning approaches for planning in LLMs, evaluation metrics tailored to latent plans, and practical applications in computational journalism, web agents, and other creative domains. By bridging theoretical concepts and practical demonstrations, this tutorial aims to inspire new research directions in leveraging LLMs for creative and goal-oriented planning tasks.- Anthology ID:
- 2025.naacl-tutorial.1
- Volume:
- Proceedings of the 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 5: Tutorial Abstracts)
- Month:
- May
- Year:
- 2025
- Address:
- Albuquerque, New Mexico
- Editors:
- Maria Lomeli, Swabha Swayamdipta, Rui Zhang
- Venue:
- NAACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1–9
- Language:
- URL:
- https://preview.aclanthology.org/fix-sig-urls/2025.naacl-tutorial.1/
- DOI:
- Cite (ACL):
- Alexander Spangher, Tenghao Huang, Philippe Laban, and Nanyun Peng. 2025. Creative Planning with Language Models: Practice, Evaluation and Applications. In Proceedings of the 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 5: Tutorial Abstracts), pages 1–9, Albuquerque, New Mexico. Association for Computational Linguistics.
- Cite (Informal):
- Creative Planning with Language Models: Practice, Evaluation and Applications (Spangher et al., NAACL 2025)
- PDF:
- https://preview.aclanthology.org/fix-sig-urls/2025.naacl-tutorial.1.pdf