Towards Scalable Lifelong Knowledge Editing with Selective Knowledge Suppression

Dahyun Jung, Jaewook Lee, Heuiseok Lim


Abstract
Large language models (LLMs) require frequent knowledge updates to reflect changing facts and mitigate hallucinations. To meet this demand, lifelong knowledge editing has emerged as a continual approach to modify specific pieces of knowledge without retraining the entire model. Existing parameter-editing methods struggle with stability during sequential edits due to catastrophic forgetting. While retrieval-based approaches are proposed to alleviate this issue, their applicability remains limited across various datasets because of high training costs. To address these limitations and enhance scalability in lifelong settings, we propose LightEdit. Our framework first selects relevant knowledge from retrieved information to modify the query effectively. It then incorporates a decoding strategy to suppress the model’s original knowledge probabilities, thereby enabling efficient edits based on the selected information. Extensive experiments on ZSRE, Counterfact, and RIPE benchmarks demonstrate that LightEdit outperforms existing lifelong knowledge editing methods. Furthermore, by minimizing training costs, LightEdit achieves cost-effective scalability, enabling easy adaptation to various datasets.
Anthology ID:
2026.acl-long.145
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3215–3231
Language:
URL:
https://preview.aclanthology.org/check-for-anonymous-pdfs/2026.acl-long.145/
DOI:
Bibkey:
Cite (ACL):
Dahyun Jung, Jaewook Lee, and Heuiseok Lim. 2026. Towards Scalable Lifelong Knowledge Editing with Selective Knowledge Suppression. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3215–3231, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Towards Scalable Lifelong Knowledge Editing with Selective Knowledge Suppression (Jung et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/check-for-anonymous-pdfs/2026.acl-long.145.pdf
Checklist:
 2026.acl-long.145.checklist.pdf