MUSE: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profiles

Zihan Wang, Xiaocui Yang, YongKang Liu, Shi Feng, Daling Wang, Yifei Zhang


Abstract
Current conversational recommendation systems focus predominantly on text. However, real-world recommendation settings are generally multimodal, causing a significant gap between existing research and practical applications. To address this issue, we propose Muse, the first multimodal conversational recommendation dataset. Muse comprises 83,148 utterances from 7,000 conversations centered around the Clothing domain. Each conversation contains comprehensive multimodal interactions, rich elements, and natural dialogues. Data in Muse are automatically synthesized by a multi-agent framework powered by multimodal large language models (MLLMs). It innovatively derives user profiles from real-world scenarios rather than depending on manual design and history data for better scalability, and then it fulfills conversation simulation and optimization. Both human and LLM evaluations demonstrate the high quality of conversations in Muse. Additionally, fine-tuning experiments on three MLLMs demonstrate Muse’s learnable patterns for recommendations and responses, confirming its value for multimodal conversational recommendation. Our dataset and codes are available at https://anonymous.4open.science/r/Muse-0086.
Anthology ID:
2025.findings-acl.58
Volume:
Findings of the Association for Computational Linguistics: ACL 2025
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1027–1053
Language:
URL:
https://preview.aclanthology.org/display_plenaries/2025.findings-acl.58/
DOI:
Bibkey:
Cite (ACL):
Zihan Wang, Xiaocui Yang, YongKang Liu, Shi Feng, Daling Wang, and Yifei Zhang. 2025. MUSE: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profiles. In Findings of the Association for Computational Linguistics: ACL 2025, pages 1027–1053, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
MUSE: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profiles (Wang et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/display_plenaries/2025.findings-acl.58.pdf