Dissecting GraphRAG: A Modular Analysis of Knowledge Structuring for Factoid Question Answering
Noriki Nishida, Rumana Ferdous Munne, Shanshan Liu, Narumi Tokunaga, Yuki Yamagata, Fei Cheng, Kouji Kozaki, Yuji Matsumoto
Abstract
We present a systematic analysis of module-level design choices in GraphRAG, a retrieval-augmented generation framework that integrates structured knowledge graphs into question answering. Focusing on triple extraction, community clustering, and report generation, we evaluate multiple strategies across two knowledge-intensive benchmarks. Our results show that high-quality triple extraction is critical, as the accuracy and coverage of the resulting knowledge graph can become a bottleneck for downstream reasoning. We also find that the granularity of fundamental knowledge units, as determined by community clustering, has a significant impact on downstream performance: Achieving a balance between factual detail and topical coherence within each unit is important to enable precise and comprehensive retrieval and to facilitate effective multi-hop reasoning. In addition, simple template-based reporting outperforms LLM-based summarization in both accuracy and efficiency. These findings provide practical guidance for the structure- aware design of retrieval-augmented systems.- Anthology ID:
- 2026.tacl-1.29
- Volume:
- Transactions of the Association for Computational Linguistics, Volume 14
- Month:
- Year:
- 2026
- Address:
- Cambridge, MA
- Venue:
- TACL
- SIG:
- Publisher:
- MIT Press
- Note:
- Pages:
- 627–655
- Language:
- URL:
- https://preview.aclanthology.org/ingest-latest-mitpress-cl-tacl/2026.tacl-1.29/
- DOI:
- 10.1162/tacl.a.615
- Cite (ACL):
- Noriki Nishida, Rumana Ferdous Munne, Shanshan Liu, Narumi Tokunaga, Yuki Yamagata, Fei Cheng, Kouji Kozaki, and Yuji Matsumoto. 2026. Dissecting GraphRAG: A Modular Analysis of Knowledge Structuring for Factoid Question Answering. Transactions of the Association for Computational Linguistics, 14:627–655.
- Cite (Informal):
- Dissecting GraphRAG: A Modular Analysis of Knowledge Structuring for Factoid Question Answering (Nishida et al., TACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-latest-mitpress-cl-tacl/2026.tacl-1.29.pdf