Temporal Information Retrieval via Time-Specifier Model Merging
SeungYoon Han, Taeho Hwang, Sukmin Cho, Soyeong Jeong, Hoyun Song, Huije Lee, Jong C. Park
Abstract
The rapid expansion of digital information and knowledge across structured and unstructured sources has heightened the importance of Information Retrieval (IR). While dense retrieval methods have substantially improved semantic matching for general queries, they consistently underperform on queries with explicit temporal constraints–often those containing numerical expressions and time specifiers such as “in 2015.” Existing approaches to Temporal Information Retrieval (TIR) improve temporal reasoning but often suffer from catastrophic forgetting, leading to reduced performance on non-temporal queries. To address this, we propose Time-Specifier Model Merging (TSM), a novel method that enhances temporal retrieval while preserving accuracy on non-temporal queries. TSM trains specialized retrievers for individual time specifiers and merges them into a unified model, enabling precise handling of temporal constraints without compromising non-temporal retrieval. Extensive experiments on both temporal and non-temporal datasets demonstrate that TSM significantly improves performance on temporally constrained queries while maintaining strong results on non-temporal queries, consistently outperforming other training methods. Our code is available at https://github.com/seungyoonee/TSM.- Anthology ID:
- 2025.knowfm-1.1
- Volume:
- Proceedings of the 3rd Workshop on Towards Knowledgeable Foundation Models (KnowFM)
- Month:
- August
- Year:
- 2025
- Address:
- Vienna, Austria
- Editors:
- Yuji Zhang, Canyu Chen, Sha Li, Mor Geva, Chi Han, Xiaozhi Wang, Shangbin Feng, Silin Gao, Isabelle Augenstein, Mohit Bansal, Manling Li, Heng Ji
- Venues:
- KnowFM | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1–13
- Language:
- URL:
- https://preview.aclanthology.org/acl25-workshop-ingestion/2025.knowfm-1.1/
- DOI:
- Cite (ACL):
- SeungYoon Han, Taeho Hwang, Sukmin Cho, Soyeong Jeong, Hoyun Song, Huije Lee, and Jong C. Park. 2025. Temporal Information Retrieval via Time-Specifier Model Merging. In Proceedings of the 3rd Workshop on Towards Knowledgeable Foundation Models (KnowFM), pages 1–13, Vienna, Austria. Association for Computational Linguistics.
- Cite (Informal):
- Temporal Information Retrieval via Time-Specifier Model Merging (Han et al., KnowFM 2025)
- PDF:
- https://preview.aclanthology.org/acl25-workshop-ingestion/2025.knowfm-1.1.pdf