Beyond Names: How Grammatical Gender Markers Bias LLM-based Educational Recommendations

Luca Benedetto, Antonia Donvito, Alberto Lucchetti, Andrea Cappelli, Paula Buttery


Abstract
This paper investigates gender biases exhibited by LLM-based virtual assistants when providing educational recommendations, focusing on minimal gender indicators. Experimenting on Italian, a language with grammatical gender, we demonstrate that simply changing noun and adjective endings (e.g., from masculine "-o" to feminine "-a") significantly shifts recommendations. More specifically, we find that LLMs i) recommend STEM disciplines less for prompts with feminine grammatical gender and ii) narrow down the set of disciplines recommended to prompts with masculine grammatical gender; these effects persist across multiple commercial LLMs (from OpenAI, Anthropic, and Google). We show that grammatical gender cues alone trigger substantial distributional shifts in educational recommendations, and up to 76% of the bias exhibited when using prompts with proper names is already present with grammatical gender markers alone.Our findings highlight the need for robust bias evaluation and mitigation strategies before deploying LLM-based virtual assistants in student-facing contexts and the risks of using general purpose LLMs for educational applications, especially in languages with grammatical gender.
Anthology ID:
2026.eacl-long.264
Volume:
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5648–5668
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.264/
DOI:
Bibkey:
Cite (ACL):
Luca Benedetto, Antonia Donvito, Alberto Lucchetti, Andrea Cappelli, and Paula Buttery. 2026. Beyond Names: How Grammatical Gender Markers Bias LLM-based Educational Recommendations. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5648–5668, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
Beyond Names: How Grammatical Gender Markers Bias LLM-based Educational Recommendations (Benedetto et al., EACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.264.pdf