HARPO: Hierarchical Agentic Reasoning for User-Aligned Conversational Recommendation

Subham Raj, Aman Vaibhav Jha, Mayank Anand, Sriparna Saha


Abstract
Conversational recommender systems (CRSs) operate under incremental preference revelation, requiring recommendation decisions under uncertainty. While recent LLM-based approaches achieve strong performance on proxy metrics such as Recall@K and BLEU, they often fail to deliver high-quality, user-aligned recommendations in practice, as they optimize intermediate objectives like retrieval accuracy or fluent generation rather than recommendation quality itself. We propose HARPO (Hierarchical Agentic Reasoning with Preference Optimization), an agentic framework that reframes conversational recommendation as a structured decision-making process optimized for multi-dimensional recommendation quality. HARPO integrates (i) hierarchical preference learning that decomposes recommendation quality into interpretable dimensions (relevance, diversity, satisfaction, and engagement) with context-dependent weighting; (ii) deliberative tree-search reasoning guided by a learned value network evaluating candidate paths on predicted quality; and (iii) domain-agnostic reasoning abstractions through Virtual Tool Operations and multi-agent refinement. We evaluate HARPO on ReDial, INSPIRED, and MUSE, demonstrating consistent improvements over strong baselines on recommendation-centric metrics while maintaining competitive response quality.
Anthology ID:
2026.acl-long.1646
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
35580–35599
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1646/
DOI:
Bibkey:
Cite (ACL):
Subham Raj, Aman Vaibhav Jha, Mayank Anand, and Sriparna Saha. 2026. HARPO: Hierarchical Agentic Reasoning for User-Aligned Conversational Recommendation. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 35580–35599, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
HARPO: Hierarchical Agentic Reasoning for User-Aligned Conversational Recommendation (Raj et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1646.pdf
Checklist:
 2026.acl-long.1646.checklist.pdf