Inductive Reasoning on Few-Shot Knowledge Graphs with Task-Aware Language Models

Cheng Yan, Feng Zhao, Ruilin Zhao, Hong Zhang


Abstract
Knowledge graphs are dynamic structures that continuously evolve as new entities emerge, often accompanied by only a handful of associated triples. Current knowledge graph reasoning methods struggle in these few-shot scenarios due to their reliance on extensive structural information.To address this limitation, we introduce ENGRAM, a novel approach that enables inductive reasoning on few-shot KGs by innovatively enriching the semantics from both textual and structural perspectives. Our key innovation lies in designing a task-aware language model that activates the language model’s in-context learning ability for structured KG tasks, effectively bridging the gap between unstructured natural language and structured tasks. Unlike prior methods that inefficiently employ classification over exhaustive candidate sets, we recast knowledge graph reasoning from a generative perspective, allowing for direct computation of inference results without iterative enumeration. Additionally, we propose a distant neighborhood awareness strategy to enrich the sparse structural features of few-shot entities.Our experimental findings indicate that our method not only achieves state-of-the-art performance in few-shot scenarios. The tunable parameters of our model are approximately 1% of those in previous language model-based methods, and the inference time has been reduced to 1/10 of that required by previous methods.
Anthology ID:
2025.findings-emnlp.677
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12656–12666
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.677/
DOI:
10.18653/v1/2025.findings-emnlp.677
Bibkey:
Cite (ACL):
Cheng Yan, Feng Zhao, Ruilin Zhao, and Hong Zhang. 2025. Inductive Reasoning on Few-Shot Knowledge Graphs with Task-Aware Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 12656–12666, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Inductive Reasoning on Few-Shot Knowledge Graphs with Task-Aware Language Models (Yan et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.677.pdf
Checklist:
 2025.findings-emnlp.677.checklist.pdf