SQUARE: Unsupervised Retrieval Adaptation via Synthetic Data

Jinsung Yoon, Junhao Zeng, Sercan O Arik


Abstract
Pre-trained retrieval models often face challenges in zero-shot retrieval for knowledge-based question answering, as different tasks rely on different corpora. We introduce SQUARE (Synthetic QUery-based Adaptive REtrieval), a novel method for corpus-specific unsupervised retrieval customization. SQUARE leverages LLMs to generate grounded synthetic question-answer pairs from the corpus, which are then used to fine-tune the retriever. A filtering mechanism based on the synthetic answers is employed to ensure high quality of tuning data. Extensive experiments on various datasets demonstrate superior performance of SQUARE compared to zero-shot retrieval and other customization methods, highlighting the value of corpus adaptation for effective retrieval.
Anthology ID:
2025.findings-emnlp.384
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7283–7297
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.384/
DOI:
10.18653/v1/2025.findings-emnlp.384
Bibkey:
Cite (ACL):
Jinsung Yoon, Junhao Zeng, and Sercan O Arik. 2025. SQUARE: Unsupervised Retrieval Adaptation via Synthetic Data. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 7283–7297, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
SQUARE: Unsupervised Retrieval Adaptation via Synthetic Data (Yoon et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.384.pdf
Checklist:
 2025.findings-emnlp.384.checklist.pdf