Consistency-Aware Online Multi-Objective Alignment for Related Search Query Generation
Shuxian Bi, Chongming Gao, Wenjie Wang, Yueqi Mou, Chenxu Wang, Tang Biao, Peng Yan, Fuli Feng
Abstract
Modern digital platforms rely on related search query recommendations to enhance engagement, yet existing methods fail to reconcile click-through rate (CTR) optimization with topic expansion. We propose **CMAQ**, a **C**onsistent **M**ulti-Objective **A**ligned **Q**uery generation framework that harmonizes these goals through three components: (1) reward modeling to quantify objectives, (2) style alignment for format compliance, and (3) consistency-aware optimization to coordinate joint improvements. CMAQ employs adaptive 𝛽-scaled DPO with geometric mean rewards, balancing CTR and expansion while mitigating objective conflicts. Extensive offline and online evaluations in a large-scale industrial setting demonstrate CMAQ’s superiority, achieving significant CTR gains (+2.3%) and higher human-rated query quality compared to state-of-the-art methods. Our approach enables high-quality query generation while sustaining user engagement and platform ecosystem health.- Anthology ID:
- 2025.acl-industry.96
- Volume:
- Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
- Month:
- July
- Year:
- 2025
- Address:
- Vienna, Austria
- Editors:
- Georg Rehm, Yunyao Li
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1365–1377
- Language:
- URL:
- https://preview.aclanthology.org/display_plenaries/2025.acl-industry.96/
- DOI:
- Cite (ACL):
- Shuxian Bi, Chongming Gao, Wenjie Wang, Yueqi Mou, Chenxu Wang, Tang Biao, Peng Yan, and Fuli Feng. 2025. Consistency-Aware Online Multi-Objective Alignment for Related Search Query Generation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track), pages 1365–1377, Vienna, Austria. Association for Computational Linguistics.
- Cite (Informal):
- Consistency-Aware Online Multi-Objective Alignment for Related Search Query Generation (Bi et al., ACL 2025)
- PDF:
- https://preview.aclanthology.org/display_plenaries/2025.acl-industry.96.pdf