Ableism, Ageism, Gender, and Nationality bias in Norwegian and Multilingual Language Models

Martin Sjåvik, Samia Touileb


Abstract
We investigate biases related to ageism, ableism, nationality, and gender in four Norwegian and two multilingual language models. Our methodology involves using a set of templates. constructed around stimuli and attributes relevant to these categories. We use statistical and predictive evaluation methods, including Kendall’s Tau correlation and dependent variable prediction rates, to assess model behaviour and output bias. Our findings indicate that models frequently associate older individuals, people with disabilities, and poorer countries with negative attributes, potentially reinforcing harmful stereotypes. However, most tested models appear to handle gender-related biases more effectively. Our findings indicate a correlation between the sentiment of the input and that of the output.
Anthology ID:
2025.gebnlp-1.32
Volume:
Proceedings of the 6th Workshop on Gender Bias in Natural Language Processing (GeBNLP)
Month:
August
Year:
2025
Address:
Vienna, Austria
Editors:
Agnieszka Faleńska, Christine Basta, Marta Costa-jussà, Karolina Stańczak, Debora Nozza
Venues:
GeBNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
379–392
Language:
URL:
https://preview.aclanthology.org/display_plenaries/2025.gebnlp-1.32/
DOI:
Bibkey:
Cite (ACL):
Martin Sjåvik and Samia Touileb. 2025. Ableism, Ageism, Gender, and Nationality bias in Norwegian and Multilingual Language Models. In Proceedings of the 6th Workshop on Gender Bias in Natural Language Processing (GeBNLP), pages 379–392, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Ableism, Ageism, Gender, and Nationality bias in Norwegian and Multilingual Language Models (Sjåvik & Touileb, GeBNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/display_plenaries/2025.gebnlp-1.32.pdf