Knowledge Graph-Driven Memory Editing with Directional Interventions

Jinhu Fu, Kun Wang, Chongye Guo, Junfeng Fang, Wentao Zhang, Sen Su


Abstract
Large Language Models (LLMs) have revolutionized language processing and understanding, yet their performance is hampered by inaccuracies and outdated information. Model editing techniques offer a solution but face two key challenges: (I) Most methods inject knowledge by constructing rigid loss, which leads to poor compatibility when dealing with higher-order multi-hop problems. (II) Locate-then-edit vein, by altering pre-trained parameters, inevitably affect normal knowledge and even face the catastrophic forgetting. In this paper, we introduce KGMET, a framework that constructs knowledge graphs using available information to guide the direction of knowledge editing, enabling consistent, aligned, and stable information during large-scale editing scenario. Furthermore, KGMET goes beyond this by employing orthogonal constraints to block the interference of irrelevant information, ensuring the updates are both controllable and generalizable. Experiments on Multi-Conterfact, ZsRE, and MQuAKE datasets using Llama-3-8B, GPT-J-6B, and GPT-2-XL models showcase improvements over state-of-the-art methods, with ↑ 5%-17% in multi-hop tasks while remaining generalizable (at least ↑ 20% in fluency). Our code is available on Github.
Anthology ID:
2025.findings-emnlp.261
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4860–4874
Language:
URL:
https://preview.aclanthology.org/ingest-nlpsi/2025.findings-emnlp.261/
DOI:
10.18653/v1/2025.findings-emnlp.261
Bibkey:
Cite (ACL):
Jinhu Fu, Kun Wang, Chongye Guo, Junfeng Fang, Wentao Zhang, and Sen Su. 2025. Knowledge Graph-Driven Memory Editing with Directional Interventions. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 4860–4874, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Knowledge Graph-Driven Memory Editing with Directional Interventions (Fu et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-nlpsi/2025.findings-emnlp.261.pdf
Checklist:
 2025.findings-emnlp.261.checklist.pdf