Think Less, Know More: State-Aware Reasoning Compression with Knowledge Guidance for Efficient Reasoning

Yi Sui, Chaozhuo Li, Dawei Song


Abstract
Large Reasoning Models (LRMs) achieve strong performance on complex tasks by leveraging long Chain-of-Thought (CoT), but often suffer from overthinking, leading to excessive reasoning steps and high inference latency. Existing CoT compression methods struggle to balance accuracy and efficiency, and lack fine-grained, step-level adaptation to redundancy and reasoning bias. Therefore, we propose State-Aware Reasoning Compression with Knowledge Guidance (STACK), a framework that performs step-wise CoT compression by explicitly modeling stage-specific redundancy sources and integrating with a retrieval-augmented guidance. STACK constructs online long–short contrastive samples and dynamically switches between knowledge-guided compression for uncertain or biased reasoning state and self-prompted compression for overly long but confident state, complemented by an answer-convergence-based early stopping mechanism to suppress redundant verification. We further propose a reward-difference-driven training strategy by combining Proximal Policy Optimization (PPO) and Direct Preference Optimization (DPO), enabling models to learn state-conditioned compression strategies. Experiments on three mathematical reasoning benchmarks show that STACK achieves a superior accuracy–efficiency balance, reducing average response length by 59.9% while improving accuracy by 4.8 points over existing methods.
Anthology ID:
2026.findings-acl.1128
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
22470–22491
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1128/
DOI:
Bibkey:
Cite (ACL):
Yi Sui, Chaozhuo Li, and Dawei Song. 2026. Think Less, Know More: State-Aware Reasoning Compression with Knowledge Guidance for Efficient Reasoning. In Findings of the Association for Computational Linguistics: ACL 2026, pages 22470–22491, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Think Less, Know More: State-Aware Reasoning Compression with Knowledge Guidance for Efficient Reasoning (Sui et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1128.pdf
Checklist:
 2026.findings-acl.1128.checklist.pdf