CLAG: Adaptive Memory Organization via Agent-Driven Clustering for Small Language Model Agents

Taeyun Roh, WonJune Jang, Junha Jung, Jaewoo Kang


Abstract
Large language model agents heavily rely on external memory to support knowledge reuse and complex reasoning tasks. Yet most memory systems store experiences in a single global retrieval pool which can gradually dilute or corrupt stored knowledge. This problem is especially pronounced for small language models (SLMs), which are highly vulnerable to irrelevant context. We introduce CLAG, a CLustering-based AGentic memory framework where an agent actively organizes memory. CLAG employs an SLM-agent driven router to assign each new memory to a semantically coherent cluster. By performing continual evolution within the cluster, it effectively reduces cross-topic interference. During the retrieval phase, CLAG targets a small set of relevant clusters for retrieval, thereby excluding distractors and reducing the search space. Experiments on multiple QA datasets with three SLM backbones show that CLAG consistently improves answer quality and robustness over prior memory systems for agents, remaining lightweight and efficient.
Anthology ID:
2026.findings-acl.824
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
16707–16726
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.824/
DOI:
Bibkey:
Cite (ACL):
Taeyun Roh, WonJune Jang, Junha Jung, and Jaewoo Kang. 2026. CLAG: Adaptive Memory Organization via Agent-Driven Clustering for Small Language Model Agents. In Findings of the Association for Computational Linguistics: ACL 2026, pages 16707–16726, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
CLAG: Adaptive Memory Organization via Agent-Driven Clustering for Small Language Model Agents (Roh et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.824.pdf
Checklist:
 2026.findings-acl.824.checklist.pdf