Language Models Predict Empathy Gaps Between Social In-groups and Out-groups

Yu Hou, Hal Daumé Iii, Rachel Rudinger


Abstract
Studies of human psychology have demonstrated that people are more motivated to extend empathy to in-group members than out-group members (Cikara et al., 2011). In this study, we investigate how this aspect of intergroup relations in humans is replicated by LLMs in an emotion intensity prediction task. In this task, the LLM is given a short description of an experience a person had that caused them to feel a particular emotion; the LLM is then prompted to predict the intensity of the emotion the person experienced on a numerical scale. By manipulating the group identities assigned to the LLM’s persona (the “perceiver”) and the person in the narrative (the “experiencer”), we measure how predicted emotion intensities differ between in-group and out-group settings. We observe that LLMs assign higher emotion intensity scores to in-group members than out-group members. This pattern holds across all three types of social groupings we tested: race/ethnicity, nationality, and religion. We perform an in-depth analysis on Llama-3.1-8B, the model which exhibited strongest intergroup bias among those tested.
Anthology ID:
2025.naacl-long.611
Volume:
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Month:
April
Year:
2025
Address:
Albuquerque, New Mexico
Editors:
Luis Chiruzzo, Alan Ritter, Lu Wang
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12288–12304
Language:
URL:
https://preview.aclanthology.org/corrections-2025-06/2025.naacl-long.611/
DOI:
10.18653/v1/2025.naacl-long.611
Bibkey:
Cite (ACL):
Yu Hou, Hal Daumé Iii, and Rachel Rudinger. 2025. Language Models Predict Empathy Gaps Between Social In-groups and Out-groups. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 12288–12304, Albuquerque, New Mexico. Association for Computational Linguistics.
Cite (Informal):
Language Models Predict Empathy Gaps Between Social In-groups and Out-groups (Hou et al., NAACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2025-06/2025.naacl-long.611.pdf