Amory: Building Coherent Narrative-Driven Agent Memory through Agentic Reasoning

Yue Zhou, Xiaobo Guo, Belhassen Bayar, Srinivasan H. Sengamedu


Abstract
Long-term conversational agents face a fundamental scalability challenge as interactions extend over time: repeatedly processing entire conversation histories becomes computationally prohibitive. Current approaches attempt to solve this through memory frameworks that predominantly fragment conversations into isolated embeddings or graph representations and retrieve relevant ones in a RAG style. While computationally efficient, these methods often treat memory formation minimally and fail to capture the subtlety and coherence of human memory. We introduce Amory, a working memory framework that actively constructs structured memory representations through enhancing agentic reasoning during offline time. Amory organizes conversational fragments into episodic narratives, consolidates memories with momentum, and semanticizes peripheral facts into semantic memory. At retrieval time, the system employs coherence-driven reasoning over narrative structures. Evaluated on the LOCOMO benchmark for long-term reasoning, Amory achieves considerable improvements over previous state-of-the-art, with performance comparable to full context reasoning while reducing response time by 50%. Analysis shows that momentum-aware consolidation significantly enhances response quality, while coherence-driven retrieval provides superior memory coverage compared to embedding-based approaches.
Anthology ID:
2026.eacl-long.183
Volume:
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3926–3938
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.183/
DOI:
Bibkey:
Cite (ACL):
Yue Zhou, Xiaobo Guo, Belhassen Bayar, and Srinivasan H. Sengamedu. 2026. Amory: Building Coherent Narrative-Driven Agent Memory through Agentic Reasoning. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3926–3938, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
Amory: Building Coherent Narrative-Driven Agent Memory through Agentic Reasoning (Zhou et al., EACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.183.pdf