ThoughtSculpt: Reasoning with Intermediate Revision and Search

Yizhou Chi, Kevin Yang, Dan Klein


Abstract
We present THOUGHTSCULPT, a general reasoning and search method for tasks with outputs that can be decomposed into components. THOUGHTSCULPT explores a search tree of potential solutions using Monte Carlo Tree Search (MCTS), building solutions one action at a time and evaluating according to any domain-specific heuristic, which in practice is often simply an LLM evaluator. Critically, our action space includes revision actions: THOUGHTSCULPT may choose to revise part of its previous output rather than continuing to build the rest of its output. Empirically, THOUGHTSCULPT outperforms state-of-the-art reasoning methods across three challenging tasks: Story Outline Improvement (up to +30% interestingness), Mini-Crosswords Solving (up to +16% word success rate), and Constrained Generation (up to +10% concept coverage).
Anthology ID:
2025.findings-naacl.428
Volume:
Findings of the Association for Computational Linguistics: NAACL 2025
Month:
April
Year:
2025
Address:
Albuquerque, New Mexico
Editors:
Luis Chiruzzo, Alan Ritter, Lu Wang
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7685–7711
Language:
URL:
https://preview.aclanthology.org/fix-sig-urls/2025.findings-naacl.428/
DOI:
Bibkey:
Cite (ACL):
Yizhou Chi, Kevin Yang, and Dan Klein. 2025. ThoughtSculpt: Reasoning with Intermediate Revision and Search. In Findings of the Association for Computational Linguistics: NAACL 2025, pages 7685–7711, Albuquerque, New Mexico. Association for Computational Linguistics.
Cite (Informal):
ThoughtSculpt: Reasoning with Intermediate Revision and Search (Chi et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-sig-urls/2025.findings-naacl.428.pdf