From ID to LLM: Rethinking Representation Learning for Recommendation
Song-Li Wu, Zhaocheng Du, Weinan Gan, Jingyi Wang, Xianquan Wang
Abstract
Recent studies indicate a fundamental incompatibility between ID representations and language model (LM) representations, as they capture behavioral and semantic spaces respectively. This mismatch leads LM representations to consistently underperform ID representations in recommendation tasks. In this work, we revisit this problem and show, from an information-theoretic perspective, that LLM representations retain all discriminative information in ID representations. Based on this, we introduce a Profile-then-Embedding (PtE) framework for recommendation, consisting of a Profile Stage, in which semantic user and item profiles are generated jointly through LLM-based bidirectional reasoning over user-item interactions, and a Personalized Embedding Stage, which encodes these profiles into task-aligned recommendation embeddings. We demonstrate PtE’s effectiveness across three benchmark datasets, including cold-start and long-tail scenarios, achieving substantial gains in both discriminative and generative recommendation models.- Anthology ID:
- 2026.acl-long.179
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 3893–3905
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.179/
- DOI:
- Cite (ACL):
- Song-Li Wu, Zhaocheng Du, Weinan Gan, Jingyi Wang, and Xianquan Wang. 2026. From ID to LLM: Rethinking Representation Learning for Recommendation. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3893–3905, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- From ID to LLM: Rethinking Representation Learning for Recommendation (Wu et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.179.pdf