Reasoning with Memory: Adaptive Information Management for Retrieval-Augmented Generation

Hieu Man, Ro-ee Tal, Abhishek Kumar, Jaejin Cho, Benjamin Hsu


Abstract
Multi-hop reasoning remains a fundamental challenge for Retrieval-Augmented Generation (RAG) systems. Recent approaches—from adaptive retrieval to agentic pipelines—struggle to maintain coherent intermediate reasoning states as chains grow longer. We introduce State-Aware RAG, a framework that addresses this limitation through an explicit working memory that serves as a dynamic cognitive workspace for reasoning. Our modular architecture features a lightweight, trainable extractor that learns to actively filter, consolidate, and update this working memory via a novel Path-Outcome Dual Reward paradigm, which balances local coherence with global strategy. The retriever and generator remain frozen, enabling plug-and-play flexibility. Experiments on eight QA benchmarks demonstrate state-of-the-art results, on average achieving +8.6% over the best memory-augmented baseline and +9.3% over the best RL-enhanced baseline. Our architecture generalizes seamlessly to stronger generators and retrievers without retraining, establishing dynamic memory management as a critical yet underexplored dimension for advancing RAG systems.
Anthology ID:
2026.findings-acl.1834
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
36825–36841
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1834/
DOI:
Bibkey:
Cite (ACL):
Hieu Man, Ro-ee Tal, Abhishek Kumar, Jaejin Cho, and Benjamin Hsu. 2026. Reasoning with Memory: Adaptive Information Management for Retrieval-Augmented Generation. In Findings of the Association for Computational Linguistics: ACL 2026, pages 36825–36841, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Reasoning with Memory: Adaptive Information Management for Retrieval-Augmented Generation (Man et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1834.pdf
Checklist:
 2026.findings-acl.1834.checklist.pdf