PRISM-MCTS: Learning from Reasoning Trajectories with Metacognitive Reflection

Siyuan Cheng, Bozhong Tian, Yanchao Hao, Zheng Wei


Abstract
The emergence of reasoning models, exemplified by OpenAI o1, signifies a transition from intuitive to deliberative cognition, effectively reorienting the scaling laws from pre-training paradigms toward test-time computation. While Monte Carlo Tree Search (MCTS) has shown promise in this domain, existing approaches typically treat each rollout as an isolated trajectory. This lack of information sharing leads to severe inefficiency and substantial computational redundancy, as the search process fails to leverage insights from prior explorations. To address these limitations, we propose PRISM-MCTS, a novel reasoning framework that draws inspiration from human parallel thinking and reflective processes. PRISM-MCTS integrates a Process Reward Model (PRM) with a dynamic shared memory, capturing both "Heuristics" and "Fallacies". By reinforcing successful strategies and pruning error-prone branches, PRISM-MCTS effectively achieves refinement. Furthermore, we develop a data-efficient training strategy for the PRM, achieving high-fidelity evaluation under a few-shot regime. Empirical evaluations across diverse reasoning benchmarks substantiate the efficacy of PRISM-MCTS. Notably, it halves the trajectory requirements on GPQA while surpassing MCTS-RAG and Search-o1, demonstrating that it scales inference by reasoning judiciously rather than exhaustively.
Anthology ID:
2026.findings-acl.807
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
16392–16402
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.807/
DOI:
Bibkey:
Cite (ACL):
Siyuan Cheng, Bozhong Tian, Yanchao Hao, and Zheng Wei. 2026. PRISM-MCTS: Learning from Reasoning Trajectories with Metacognitive Reflection. In Findings of the Association for Computational Linguistics: ACL 2026, pages 16392–16402, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
PRISM-MCTS: Learning from Reasoning Trajectories with Metacognitive Reflection (Cheng et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.807.pdf
Checklist:
 2026.findings-acl.807.checklist.pdf