Correcting on Graph: Faithful Semantic Parsing over Knowledge Graphs with Large Language Models

Ruilin Zhao, Feng Zhao, Hong Zhang


Abstract
Complex multi-hop questions often require comprehensive retrieval and reasoning. As a result, effectively parsing such questions and establishing an efficient interaction channel between large language models (LLMs) and knowledge graphs (KGs) is essential for ensuring reliable reasoning. In this paper, we present a novel semantic parsing framework Correcting on Graph (CoG), aiming to establish faithful logical queries that connect LLMs and KGs. We first propose a structured knowledge decoding that enables the LLM to generate fact-aware logical queries during inference, while leveraging its parametric knowledge to fill in the blank intermediate entities. Then, we introduce a knowledge path correction that combines the logical query with KGs to correct hallucination entities and path deficiencies in the generated content, ensuring the reliability and comprehensiveness of the retrieved knowledge. Extensive experiments demonstrate that CoG outperforms the state-of-the-art KGQA methods on two knowledge-intensive question answering benchmarks. CoG achieves a high answer hit rate and exhibits competitive F1 performance for complex multi-hop questions.
Anthology ID:
2025.findings-acl.280
Volume:
Findings of the Association for Computational Linguistics: ACL 2025
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5364–5376
Language:
URL:
https://preview.aclanthology.org/landing_page/2025.findings-acl.280/
DOI:
Bibkey:
Cite (ACL):
Ruilin Zhao, Feng Zhao, and Hong Zhang. 2025. Correcting on Graph: Faithful Semantic Parsing over Knowledge Graphs with Large Language Models. In Findings of the Association for Computational Linguistics: ACL 2025, pages 5364–5376, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Correcting on Graph: Faithful Semantic Parsing over Knowledge Graphs with Large Language Models (Zhao et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/landing_page/2025.findings-acl.280.pdf