StepKE: Stepwise Knowledge Editing for Multi-Hop Question Answering

Jaewook Lee, Dahyun Jung, Heuiseok Lim


Abstract
Knowledge editing aims to update Large Language Models (LLMs) with new information without costly retraining. However, consistently reflecting these updates in complex multi-hop Question Answering (QA), which demands reasoning over interconnected facts, is challenging. Many existing methods overlook the interplay with pre-existing knowledge, leading to inconsistent edit propagation. To overcome this, we introduce StepKE (Stepwise Knowledge Editing for Multi-hop QA), a novel framework for robustly integrating edited and existing knowledge for coherent multi-hop reasoning. StepKE uniquely decomposes multi-hop questions into sequential single-hop sub-questions, retrieving relevant facts (both edited and pre-existing) from an external knowledge graph for each step. It employs context-aware prompting with prior reasoning history and fine-tuning for precise edit propagation. This systematic integration enables effective stepwise reasoning. Experiments show StepKE generates significantly more accurate and consistent responses than baselines, showcasing strong knowledge editing and integration in multi-hop QA.
Anthology ID:
2025.findings-emnlp.409
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7752–7765
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.409/
DOI:
10.18653/v1/2025.findings-emnlp.409
Bibkey:
Cite (ACL):
Jaewook Lee, Dahyun Jung, and Heuiseok Lim. 2025. StepKE: Stepwise Knowledge Editing for Multi-Hop Question Answering. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 7752–7765, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
StepKE: Stepwise Knowledge Editing for Multi-Hop Question Answering (Lee et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.409.pdf
Checklist:
 2025.findings-emnlp.409.checklist.pdf