TopoRAG: Graph-based RAG via Topology-aware Approximate Nearest Neighbor Search

Tianhao Wu, Siqiang Luo


Abstract
Retrieval-augmented generation (RAG) has become a core technique for improving the factuality and reasoning ability of large language models. Recent efforts extend RAG with graph-structured knowledge, enhancing retrieval to capture relational context beyond isolated text chunks. However, many graph-based RAG systems rely on a two-stage pipeline: (i) classical approximate nearest neighbor (ANN) search to identify top-k entities in the embedding space, (ii) heuristic neighbor expansion which augments the retrieved set by traversing immediate neighbors. This design underutilizes graph topology during retrieval and often introduces noisy or high-degree neighbors, leading to suboptimal evidence selection. In this paper, we propose TopoRAG, a retrieval framework that directly integrates structural constraints into ANN search via a diameter-constrained formulation. By selecting entities whose induced subgraph satisfies a diameter bound, TopoRAG enables topology-aware and noise-controlled graph retrieval. Experiments show that our approach consistently improves precision and significantly reduces context redundancy compared to existing methods.
Anthology ID:
2026.findings-acl.1703
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
34097–34108
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1703/
DOI:
Bibkey:
Cite (ACL):
Tianhao Wu and Siqiang Luo. 2026. TopoRAG: Graph-based RAG via Topology-aware Approximate Nearest Neighbor Search. In Findings of the Association for Computational Linguistics: ACL 2026, pages 34097–34108, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
TopoRAG: Graph-based RAG via Topology-aware Approximate Nearest Neighbor Search (Wu & Luo, Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1703.pdf
Checklist:
 2026.findings-acl.1703.checklist.pdf