Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search

Zhiyu Cao, Peifeng Li, Qiaoming Zhu


Abstract
Conversational Query Rewriting (CQR) aims to rewrite ambiguous queries to achieve more efficient conversational search. Early studies have predominantly focused on the rewriting in isolation, ignoring the feedback from query rewrite, passage retrieval and response generation in the rewriting process. To address this issue, we propose Multi-Faceted Self-Consistent Preference Aligned CQR (MSPA-CQR). Specifically, we first construct self-consistent preference alignment data from three dimensions (rewriting, retrieval, and response) to generate more diverse rewritten queries. Then we propose prefix guided multi-faceted direct preference optimization to learn preference information from three different dimensions. The experimental results show that our MSPA-CQR is effective in both in- and out-of-distribution scenarios.
Anthology ID:
2026.findings-acl.638
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13083–13100
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.638/
DOI:
Bibkey:
Cite (ACL):
Zhiyu Cao, Peifeng Li, and Qiaoming Zhu. 2026. Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search. In Findings of the Association for Computational Linguistics: ACL 2026, pages 13083–13100, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search (Cao et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.638.pdf
Checklist:
 2026.findings-acl.638.checklist.pdf