TamEdit: Trajectory-Aware Meta-Learning for Specificity-Preserving Continual Knowledge Editing

Shiqiang Tian, Cheng Ding, Qin Chen, Jie Zhou, Liang He


Abstract
Knowledge editing is a promising method for updating Large Language Models efficiently. However, previous studies often suffer from poor specificity in continual editing, as they typically focus on single edits or preventing knowledge forgetting. To address this, we propose TamEdit, a trajectory-aware meta-learning method that preserves specificity for continual knowledge editing. TamEdit unifies three levels: Inner Optimization performs multi-step fast fine-tuning on the single edit; Trajectory-based Editing unifies continual edits with a growing memory; and Outer Optimization leverages meta-learning to distill cross-task strategies for preserving specificity. By capturing the relationships between different single edits within the trajectory, our method learns how to effectively avoid specificity drift. Experiments across multiple LLMs show TamEdit significantly outperforms baselines in continual editing, improving specificity by 14.81% with fast speed (requiring only 8.84% of the time cost of most baselines), while preserving general capabilities.
Anthology ID:
2026.acl-long.979
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
21417–21439
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.979/
DOI:
Bibkey:
Cite (ACL):
Shiqiang Tian, Cheng Ding, Qin Chen, Jie Zhou, and Liang He. 2026. TamEdit: Trajectory-Aware Meta-Learning for Specificity-Preserving Continual Knowledge Editing. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 21417–21439, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
TamEdit: Trajectory-Aware Meta-Learning for Specificity-Preserving Continual Knowledge Editing (Tian et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.979.pdf
Checklist:
 2026.acl-long.979.checklist.pdf