Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM Responses
Yishan Wang, Amanda Cercas Curry, Flor Miriam Plaza-del-Arco
Abstract
As large language models (LLMs) increasingly assist in subjective decision-making (e.g., moral reasoning, advice), it is critical to understand whose preferences they align with—and why. While prior work uses aggregate human judgments, demographic variation and its linguistic drivers remain underexplored. We present a comprehensive analysis of how demographic background and empathy level correlate with preferences for LLM-generated dilemma responses, alongside a systematic study of predictive linguistic features (e.g., agency, emotional tone). Our findings reveal significant demographic divides and identify markers (e.g., power verbs, tentative phrasing) that predict group-level differences. These results underscore the need for demographically informed LLM evaluation.- Anthology ID:
- 2025.findings-emnlp.935
- Volume:
- Findings of the Association for Computational Linguistics: EMNLP 2025
- Month:
- November
- Year:
- 2025
- Address:
- Suzhou, China
- Editors:
- Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 17257–17270
- Language:
- URL:
- https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.935/
- DOI:
- 10.18653/v1/2025.findings-emnlp.935
- Cite (ACL):
- Yishan Wang, Amanda Cercas Curry, and Flor Miriam Plaza-del-Arco. 2025. Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM Responses. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 17257–17270, Suzhou, China. Association for Computational Linguistics.
- Cite (Informal):
- Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM Responses (Wang et al., Findings 2025)
- PDF:
- https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.935.pdf