MAKI: Multi-layer Aligned Knowledge Injection for Structure-aware Knowledge Graph Completion with Large Language Models

Zhiwen Xie, Xin Wang, Guangyou Zhou, Derek F. Wong


Abstract
Recent advances in large language models (LLMs) have shown strong potential for knowledge graph completion (KGC). However, existing LLM-based approaches often struggle to effectively capture the structural information in knowledge graphs (KGs), leading to suboptimal reasoning performance. To address this challenge, we propose a Multi-layer Aligned Knowledge Injection (MAKI) model, a novel method that tightly integrates structured KG information into LLMs through multi-layer alignment. Specifically, we first leverage LLMs to encode the textual information of entities and relations, obtaining their semantic representations across multiple hidden layers. We then introduce a multi-layer aligned structure learning module, which uses graph neural networks (GNNs) to learn relational structures while aligning with the corresponding LLM layers to bridge the gap between structural and semantic spaces. Finally, a gated fusion mechanism is used to inject the structured knowledge into the LLM for reasoning over candidate triples. Experimental results on various benchmark datasets demonstrate that the proposed MAKI outperforms existing state-of-the-art methods.
Anthology ID:
2026.findings-acl.1423
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
28527–28539
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1423/
DOI:
Bibkey:
Cite (ACL):
Zhiwen Xie, Xin Wang, Guangyou Zhou, and Derek F. Wong. 2026. MAKI: Multi-layer Aligned Knowledge Injection for Structure-aware Knowledge Graph Completion with Large Language Models. In Findings of the Association for Computational Linguistics: ACL 2026, pages 28527–28539, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
MAKI: Multi-layer Aligned Knowledge Injection for Structure-aware Knowledge Graph Completion with Large Language Models (Xie et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1423.pdf
Checklist:
 2026.findings-acl.1423.checklist.pdf