Abstract
This paper studies the use of style embeddings to enhance author profiling for the goal of personalization of Large Language Models (LLMs). Using a style-based Retrieval-Augmented Generation (RAG) approach, we meticulously study the efficacy of style embeddings in capturing distinctive authorial nuances. The proposed method leverages this acquired knowledge to enhance the personalization capabilities of LLMs. In the assessment of this approach, we have employed the LaMP benchmark, specifically tailored for evaluating language models across diverse dimensions of personalization. The empirical observations from our investigation reveal that, in comparison to term matching or context matching, style proves to be marginally superior in the development of personalized LLMs.- Anthology ID:
- 2024.personalize-1.11
- Volume:
- Proceedings of the 1st Workshop on Personalization of Generative AI Systems (PERSONALIZE 2024)
- Month:
- March
- Year:
- 2024
- Address:
- St. Julians, Malta
- Editors:
- Ameet Deshpande, EunJeong Hwang, Vishvak Murahari, Joon Sung Park, Diyi Yang, Ashish Sabharwal, Karthik Narasimhan, Ashwin Kalyan
- Venues:
- PERSONALIZE | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 119–123
- Language:
- URL:
- https://aclanthology.org/2024.personalize-1.11
- DOI:
- Cite (ACL):
- Abhiman Neelakanteswara, Shreyas Chaudhari, and Hamed Zamani. 2024. RAGs to Style: Personalizing LLMs with Style Embeddings. In Proceedings of the 1st Workshop on Personalization of Generative AI Systems (PERSONALIZE 2024), pages 119–123, St. Julians, Malta. Association for Computational Linguistics.
- Cite (Informal):
- RAGs to Style: Personalizing LLMs with Style Embeddings (Neelakanteswara et al., PERSONALIZE-WS 2024)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2024.personalize-1.11.pdf