Amory: Building Coherent Narrative-Driven Agent Memory through Agentic Reasoning
Yue Zhou, Xiaobo Guo, Belhassen Bayar, Srinivasan H. Sengamedu
Abstract
Long-term conversational agents face a fundamental scalability challenge as interactions extend over time: repeatedly processing entire conversation histories becomes computationally prohibitive. Current approaches attempt to solve this through memory frameworks that predominantly fragment conversations into isolated embeddings or graph representations and retrieve relevant ones in a RAG style. While computationally efficient, these methods often treat memory formation minimally and fail to capture the subtlety and coherence of human memory. We introduce Amory, a working memory framework that actively constructs structured memory representations through enhancing agentic reasoning during offline time. Amory organizes conversational fragments into episodic narratives, consolidates memories with momentum, and semanticizes peripheral facts into semantic memory. At retrieval time, the system employs coherence-driven reasoning over narrative structures. Evaluated on the LOCOMO benchmark for long-term reasoning, Amory achieves considerable improvements over previous state-of-the-art, with performance comparable to full context reasoning while reducing response time by 50%. Analysis shows that momentum-aware consolidation significantly enhances response quality, while coherence-driven retrieval provides superior memory coverage compared to embedding-based approaches.- Anthology ID:
- 2026.eacl-long.183
- Volume:
- Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- March
- Year:
- 2026
- Address:
- Rabat, Morocco
- Editors:
- Vera Demberg, Kentaro Inui, Lluís Marquez
- Venue:
- EACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 3926–3938
- Language:
- URL:
- https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.183/
- DOI:
- Cite (ACL):
- Yue Zhou, Xiaobo Guo, Belhassen Bayar, and Srinivasan H. Sengamedu. 2026. Amory: Building Coherent Narrative-Driven Agent Memory through Agentic Reasoning. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3926–3938, Rabat, Morocco. Association for Computational Linguistics.
- Cite (Informal):
- Amory: Building Coherent Narrative-Driven Agent Memory through Agentic Reasoning (Zhou et al., EACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.183.pdf