Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context

Marion Bartl, Thomas Brendan Murphy, Susan Leavy


Abstract
Gender-inclusive language is often used with the aim of ensuring that all individuals, regardless of gender, can be associated with certain concepts. While psycholinguistic studies have examined its effects in relation to human cognition, it remains unclear how Large Language Models (LLMs) process gender-inclusive language. Given that commercial LLMs are gaining an increasingly strong foothold in everyday applications, it is crucial to examine whether LLMs in fact interpret gender-inclusive language neutrally, because the language they generate has the potential to influence the language of their users. This study examines whether LLM-generated coreferent terms align with a given gender expression or reflect model biases. Adapting psycholinguistic methods from French to English and German, we find that in English, LLMs generally maintain the antecedent’s gender but exhibit underlying masculine bias. In German, this bias is much stronger, overriding all tested gender-neutralization strategies.
Anthology ID:
2025.gebnlp-1.38
Volume:
Proceedings of the 6th Workshop on Gender Bias in Natural Language Processing (GeBNLP)
Month:
August
Year:
2025
Address:
Vienna, Austria
Editors:
Agnieszka Faleńska, Christine Basta, Marta Costa-jussà, Karolina Stańczak, Debora Nozza
Venues:
GeBNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
451–467
Language:
URL:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.gebnlp-1.38/
DOI:
Bibkey:
Cite (ACL):
Marion Bartl, Thomas Brendan Murphy, and Susan Leavy. 2025. Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context. In Proceedings of the 6th Workshop on Gender Bias in Natural Language Processing (GeBNLP), pages 451–467, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context (Bartl et al., GeBNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.gebnlp-1.38.pdf