Aligning Language Models with Real-time Knowledge Editing

Chenming Tang, Yutong Yang, Kexue Wang, Yunfang Wu


Abstract
Knowledge editing aims to modify outdated knowledge in language models efficiently while retaining their original capabilities. Mainstream datasets for knowledge editing are predominantly static and fail to keep in pace with the evolving real-world knowledge. In this work, we introduce CRAFT, an ever-evolving real-world dataset for knowledge editing. It evaluates models on temporal locality, common-sense locality, composite portability and alias portability, providing a comprehensive and challenging evaluation for knowledge editing, on which previous methods hardly achieve balanced performance. Towards flexible real-time knowledge editing, we propose KEDAS, a novel paradigm of knowledge editing alignment featuring diverse edit augmentation and self-adaptive post-alignment inference, exhibiting significant performance gain on both CRAFT and traditional datasets compared to previous methods. We hope this work may serve as a catalyst for shifting the focus of knowledge editing from static update to dynamic evolution.
Anthology ID:
2026.acl-long.14
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
363–378
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.14/
DOI:
Bibkey:
Cite (ACL):
Chenming Tang, Yutong Yang, Kexue Wang, and Yunfang Wu. 2026. Aligning Language Models with Real-time Knowledge Editing. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 363–378, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Aligning Language Models with Real-time Knowledge Editing (Tang et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.14.pdf
Checklist:
 2026.acl-long.14.checklist.pdf