Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM Responses

Yishan Wang, Amanda Cercas Curry, Flor Miriam Plaza-del-Arco


Abstract
As large language models (LLMs) increasingly assist in subjective decision-making (e.g., moral reasoning, advice), it is critical to understand whose preferences they align with—and why. While prior work uses aggregate human judgments, demographic variation and its linguistic drivers remain underexplored. We present a comprehensive analysis of how demographic background and empathy level correlate with preferences for LLM-generated dilemma responses, alongside a systematic study of predictive linguistic features (e.g., agency, emotional tone). Our findings reveal significant demographic divides and identify markers (e.g., power verbs, tentative phrasing) that predict group-level differences. These results underscore the need for demographically informed LLM evaluation.
Anthology ID:
2025.findings-emnlp.935
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
17257–17270
Language:
URL:
https://preview.aclanthology.org/name-variant-enfa-fane/2025.findings-emnlp.935/
DOI:
10.18653/v1/2025.findings-emnlp.935
Bibkey:
Cite (ACL):
Yishan Wang, Amanda Cercas Curry, and Flor Miriam Plaza-del-Arco. 2025. Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM Responses. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 17257–17270, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM Responses (Wang et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/name-variant-enfa-fane/2025.findings-emnlp.935.pdf
Checklist:
 2025.findings-emnlp.935.checklist.pdf