Chi Zhang
Other people with similar names: Chi Zhang, Chi Zhang, Chi Zhang, Chi Zhang
Unverified author pages with similar names: Chi Zhang
2026
Spectral Characterization and Mitigation of Sequential Knowledge Editing Collapse
Chi Zhang | Mengqi Zhang | Xiaotian Ye | Runxi Cheng | Zisheng Zhou | Ying Zhou | Pengjie Ren | Zhumin Chen
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Chi Zhang | Mengqi Zhang | Xiaotian Ye | Runxi Cheng | Zisheng Zhou | Ying Zhou | Pengjie Ren | Zhumin Chen
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Sequential knowledge editing in large language models often causes catastrophic collapse of the model’s general abilities, especially for parameter-modifying methods. Existing approaches mitigate this issue through heuristic constraints on parameter updates, the mechanisms underlying such degradation remain insufficiently understood. In this work, we present a systematic spectral analysis of sequential knowledge editing and show that a model’s general abilities are closely associated with dominant singular directions of pretrained weight matrices. These directions are highly sensitive to perturbations and are progressively disrupted by repeated edits, closely tracking the collapse in both editing efficacy and general performance. Building on this insight, we propose REVIVE, a plug-and-play framework that prevents model collapse by explicitly preserving this dominant subspace. REVIVE analyzes parameter updates in the spectral basis of the original weights and filters out components that would interfere with the dominant subspace. Extensive experiments across multiple models and benchmarks show that REVIVE consistently improves editing efficacy while substantially preserving general abilities under long-horizon sequential editing, including extreme settings with up to 20,000 edits.