Test-Time Training for Zero-Resource Dense Retrieval Reranking

Shiyan Liu, Yichen Li


Abstract
Dense retrievers excel at first-stage candidate generation but lack effective reranking in zero-resource settings. Existing approaches face a fundamental dilemma: cross-encoders deliver strong reranking quality but require costly supervised training and incur high latency, while unsupervised BM25 reranking consistently degrades dense retrieval performance on most of BEIR benchmarks. We propose DART (Dense Adaptive Reranking at Test-time), which resolves this dilemma by adapting the scoring function at inference time. For each query, the top-ranked documents serve as pseudo-positive examples and the bottom-ranked as pseudo-negative examples, providing noisy but readily available supervision to adapt a bilinear scoring matrix W via a small number of gradient updates. We further introduce a confidence-weighted margin loss and a cross-query momentum buffer that warm-starts adaptation across queries. On six BEIR benchmarks, DART achieves a mean per-dataset relative NDCG@10 gain of +2.1% over the dense retrieval baseline with under 10ms additional latency per query, demonstrating a powerful capability for zero-shot performance enhancement and cross-domain generalization.
Anthology ID:
2026.knowfm-1.8
Volume:
Proceedings of the 4th Workshop on Towards Knowledgeable Foundation Models (KnowFM 2026)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Canyu Chen, Yuji Zhang, Zoey Sha Li, Zihan Wang, Qineng Wang, Jinyan Su, Priyanka Kargupta, Sara Vera Marjanović, Jeff Z. Pan, Mohit Bansal, Isabelle Augenstein, Jiawei Han, Heng Ji, Manling Li
Venues:
KnowFM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
105–114
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.knowfm-1.8/
DOI:
Bibkey:
Cite (ACL):
Shiyan Liu and Yichen Li. 2026. Test-Time Training for Zero-Resource Dense Retrieval Reranking. In Proceedings of the 4th Workshop on Towards Knowledgeable Foundation Models (KnowFM 2026), pages 105–114, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Test-Time Training for Zero-Resource Dense Retrieval Reranking (Liu & Li, KnowFM 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.knowfm-1.8.pdf