Think More, Hallucinate Less: Mitigating Hallucinations via Dual Process of Fast and Slow Thinking

Xiaoxue Cheng, Junyi Li, Xin Zhao, Ji-Rong Wen


Abstract
Large language models (LLMs) demonstrate exceptional capabilities, yet still face the hallucination issue. Typical text generation approaches adopt an auto-regressive generation without deliberate reasoning, often leading to untrustworthy and factually inaccurate responses. In this paper, we propose HaluSearch, a novel framework that incorporates tree search-based algorithms (e.g., MCTS) to enable an explicit slow thinking generation process for mitigating hallucinations during inference. Specifically, HaluSearch frames text generation as a step-by-step reasoning process, using a self-evaluation reward model to score each generation step and guide the tree search towards the most reliable generation pathway. To balance efficiency and quality, we introduce a hierarchical system switch mechanism, which dynamically switches between fast and slow thinking modes at both instance and step levels. We conduct extensive experiments on both English and Chinese datasets, and the results show that our approach significantly outperforms baseline approaches.
Anthology ID:
2025.findings-acl.417
Volume:
Findings of the Association for Computational Linguistics: ACL 2025
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7979–7990
Language:
URL:
https://preview.aclanthology.org/landing_page/2025.findings-acl.417/
DOI:
Bibkey:
Cite (ACL):
Xiaoxue Cheng, Junyi Li, Xin Zhao, and Ji-Rong Wen. 2025. Think More, Hallucinate Less: Mitigating Hallucinations via Dual Process of Fast and Slow Thinking. In Findings of the Association for Computational Linguistics: ACL 2025, pages 7979–7990, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Think More, Hallucinate Less: Mitigating Hallucinations via Dual Process of Fast and Slow Thinking (Cheng et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/landing_page/2025.findings-acl.417.pdf