SpecEdit: A Spectral Approach for Multi-Round Knowledge Editing

Junxian Liu, Zikun Deng, Xin Wu, Dazhen Deng, Yi Cai


Abstract
Multi-round batch knowledge editing often suffers from performance degradation as edits accumulate. Focusing on the locate-then-edit paradigm, we analyze this phenomenon from a spectral perspective and identify a previously overlooked structural factor: the intrinsic knowledge of the model and historical edit memories exhibit markedly different spectral characteristics and information distributions, yet are naively coupled and jointly inverted during editing. Based on this insight, we propose SpecEdit to improve the model editing from a spectral perspective. SpecEdit performs spectral decoupling to isolate editing-critical directions and reduce destructive coupling, followed by spectral-structure-aware information compensation and spectral fusion to construct a refined closed-form solution. The module integrates seamlessly into existing editing methods without altering their original optimization procedures. Experiments on multiple LLMs and editing methods show that SpecEdit consistently improves performance, demonstrating that modeling spectral structure is an effective, interpretable approach and a promising direction for future research.
Anthology ID:
2026.findings-acl.922
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
18511–18524
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.922/
DOI:
Bibkey:
Cite (ACL):
Junxian Liu, Zikun Deng, Xin Wu, Dazhen Deng, and Yi Cai. 2026. SpecEdit: A Spectral Approach for Multi-Round Knowledge Editing. In Findings of the Association for Computational Linguistics: ACL 2026, pages 18511–18524, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
SpecEdit: A Spectral Approach for Multi-Round Knowledge Editing (Liu et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.922.pdf
Checklist:
 2026.findings-acl.922.checklist.pdf