One Persona, Many Cues, Different Results: How Sociodemographic Cues Impact LLM Personalization
Franziska Weeber, Vera Neplenbroek, Jan Batzner, Sebastian Pad\'o
Abstract
Personalization of LLMs by sociodemographic subgroup often improves user experience, but can also introduce or amplify biases and unfairoutcomes across groups. Prior work has employed so-called personas, sociodemographic user attributes conveyed to a model, to studybias in LLMs by relying on a single cue to prompt a persona, such as user names or explicit attribute mentions. This disregards LLM sensitivity to prompt variation and the rarity of some cues in real interactions (external validity). We compare six commonly used personacues across seven open and proprietary LLMs on four writing and advice tasks. While cues are overall highly correlated, they produce sub-stantial variance in responses across personas that can change findings on persona-induced differences and bias. We therefore cautionagainst claims based on single persona cues, especially when they are overly explicit and have low external validity.- Anthology ID:
- 2026.acl-long.2079
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 44892–44921
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.2079/
- DOI:
- Cite (ACL):
- Franziska Weeber, Vera Neplenbroek, Jan Batzner, and Sebastian Pad\'o. 2026. One Persona, Many Cues, Different Results: How Sociodemographic Cues Impact LLM Personalization. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 44892–44921, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- One Persona, Many Cues, Different Results: How Sociodemographic Cues Impact LLM Personalization (Weeber et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.2079.pdf