@inproceedings{feng-etal-2025-expectation,
    title = "Expectation Confirmation Preference Optimization for Multi-Turn Conversational Recommendation Agent",
    author = "Feng, Xueyang  and
      Zhang, Jingsen  and
      Tang, Jiakai  and
      Li, Wei  and
      Cai, Guohao  and
      Chen, Xu  and
      Dai, Quanyu  and
      Zhu, Yue  and
      Dong, Zhenhua",
    editor = "Che, Wanxiang  and
      Nabende, Joyce  and
      Shutova, Ekaterina  and
      Pilehvar, Mohammad Taher",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2025",
    month = jul,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/landing_page/2025.findings-acl.307/",
    pages = "5896--5914",
    ISBN = "979-8-89176-256-5",
    abstract = "Recent advancements in Large Language Models (LLMs) have significantly propelled the development of Conversational Recommendation Agents (CRAs). However, these agents often generate short-sighted responses that fail to sustain user guidance and meet expectations. Although preference optimization has proven effective in aligning LLMs with user expectations, it remains costly and performs poorly in multi-turn dialogue. To address this challenge, we introduce a novel multi-turn preference optimization (MTPO) paradigm **ECPO**, which leverages Expectation Confirmation Theory to explicitly model the evolution of user satisfaction throughout multi-turn dialogues, uncovering the underlying causes of dissatisfaction. These causes can be utilized to support targeted optimization of unsatisfactory responses, thereby achieving turn-level preference optimization. ECPO eliminates the significant sampling overhead of existing MTPO methods while ensuring the optimization process drives meaningful improvements. To support ECPO, we also introduce an LLM-based user simulator, **AILO**, to simulate user feedback and expectation confirmation during conversational recommendations. Experimental results show that ECPO significantly enhances CRA{'}s interaction capabilities, offering notable improvements in both efficiency and effectiveness over existing MTPO methods."
}