Query-Aware Graph Attention for Precise Subgraph Retrieval in Knowledge-Augmented Reasoning

Yuanye Xu, Linyi Guo, Yue Zhang, Fu Ning


Abstract
Large language models (LLMs) increasingly rely on external knowledge to mitigate hallucinations, yet retrieving precise multi-hop evidence for knowledge-augmented reasoning remains difficult. Existing Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) systems insufficiently model the interaction between query semantics and relation types, resulting in imprecise subgraph retrieval and unstable reasoning. We propose Query-aware Subgraph Retrieval Augmented Generation (QSRAG), a retrieval framework built upon a Query-Relational Graph Attention Network (QR-GAT) that integrates query semantics and relation embeddings directly into the attention mechanism, enabling fine-grained triple scoring and scalable subgraph construction. This query–relation conditioning improves relevance estimation and suppresses noisy edges, producing faithful reasoning subgraphs. Experiments on WebQSP and CWQ establish new state-of-the-art results in both Triple Recall and Answer Recall, and significantly enhance LLMs reasoning accuracy without fine-tuning. These findings underscore the effectiveness of modeling query–relation interactions for reliable knowledge-augmented reasoning.
Anthology ID:
2026.findings-acl.398
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8127–8148
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.398/
DOI:
Bibkey:
Cite (ACL):
Yuanye Xu, Linyi Guo, Yue Zhang, and Fu Ning. 2026. Query-Aware Graph Attention for Precise Subgraph Retrieval in Knowledge-Augmented Reasoning. In Findings of the Association for Computational Linguistics: ACL 2026, pages 8127–8148, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Query-Aware Graph Attention for Precise Subgraph Retrieval in Knowledge-Augmented Reasoning (Xu et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.398.pdf
Checklist:
 2026.findings-acl.398.checklist.pdf