GraphMind: LLMs as Dynamic Knowledge Builders for Sequential Decision-Making
Sunguk Shin, Hayeong Lee, Jun Ho Seo, Jinho Lee, Myunsoo Kim, Minsuk Chang, Byung-Jun Lee
Abstract
While the reasoning capabilities of large language models (LLMs) have advanced considerably, efficiently internalizing and leveraging new information in dynamically interactive environments remains a significant challenge. This limitation is particularly pronounced in partially observable environments, which require agents to manage long-term memory and perform effective exploration under incomplete information. To address this, we propose an LLM agent architecture that integrates a knowledge graph as a graph-based memory module. The agent incrementally constructs the knowledge graph through environmental interactions and retrieves relevant information to generate efficient plans. We evaluate our approach in complex navigation tasks specifically designed to present long-horizon and partially observable challenges. Experimental results demonstrate that incorporating a self-extending memory module significantly enhances the performance and efficiency of the LLM’s planning capabilities.- Anthology ID:
- 2026.findings-acl.1651
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 32985–33007
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1651/
- DOI:
- Cite (ACL):
- Sunguk Shin, Hayeong Lee, Jun Ho Seo, Jinho Lee, Myunsoo Kim, Minsuk Chang, and Byung-Jun Lee. 2026. GraphMind: LLMs as Dynamic Knowledge Builders for Sequential Decision-Making. In Findings of the Association for Computational Linguistics: ACL 2026, pages 32985–33007, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- GraphMind: LLMs as Dynamic Knowledge Builders for Sequential Decision-Making (Shin et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1651.pdf