GraphMind: LLMs as Dynamic Knowledge Builders for Sequential Decision-Making

Sunguk Shin, Hayeong Lee, Jun Ho Seo, Jinho Lee, Myunsoo Kim, Minsuk Chang, Byung-Jun Lee


Abstract
While the reasoning capabilities of large language models (LLMs) have advanced considerably, efficiently internalizing and leveraging new information in dynamically interactive environments remains a significant challenge. This limitation is particularly pronounced in partially observable environments, which require agents to manage long-term memory and perform effective exploration under incomplete information. To address this, we propose an LLM agent architecture that integrates a knowledge graph as a graph-based memory module. The agent incrementally constructs the knowledge graph through environmental interactions and retrieves relevant information to generate efficient plans. We evaluate our approach in complex navigation tasks specifically designed to present long-horizon and partially observable challenges. Experimental results demonstrate that incorporating a self-extending memory module significantly enhances the performance and efficiency of the LLM’s planning capabilities.
Anthology ID:
2026.findings-acl.1651
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
32985–33007
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1651/
DOI:
Bibkey:
Cite (ACL):
Sunguk Shin, Hayeong Lee, Jun Ho Seo, Jinho Lee, Myunsoo Kim, Minsuk Chang, and Byung-Jun Lee. 2026. GraphMind: LLMs as Dynamic Knowledge Builders for Sequential Decision-Making. In Findings of the Association for Computational Linguistics: ACL 2026, pages 32985–33007, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
GraphMind: LLMs as Dynamic Knowledge Builders for Sequential Decision-Making (Shin et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1651.pdf
Checklist:
 2026.findings-acl.1651.checklist.pdf