Dual Debiasing: Remove Stereotypes and Keep Factual Gender for Fair Language Modeling and Translation

Tomasz Limisiewicz, David Mareček, Tomáš Musil


Abstract
Mitigation of biases, such as language models’ reliance on gender stereotypes, is a crucial endeavor required for the creation of reliable and useful language technology. The crucial aspect of debiasing is to ensure that the models preserve their versatile capabilities, including their ability to solve language tasks and equitably represent various genders. To address these issues, we introduce Dual Dabiasing Algorithm through Model Adaptation (2DAMA). Novel Dual Debiasing enables robust reduction of stereotypical bias while preserving desired factual gender information encoded by language models. We show that 2DAMA effectively reduces gender bias in language models for English and is one of the first approaches facilitating the mitigation of their stereotypical tendencies in translation. The proposed method’s key advantage is the preservation of factual gender cues, which are useful in a wide range of natural language processing tasks.
Anthology ID:
2025.inlg-main.10
Volume:
Proceedings of the 18th International Natural Language Generation Conference
Month:
October
Year:
2025
Address:
Hanoi, Vietnam
Editors:
Lucie Flek, Shashi Narayan, Lê Hồng Phương, Jiahuan Pei
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
148–164
Language:
URL:
https://preview.aclanthology.org/author-page-you-zhang-rochester/2025.inlg-main.10/
DOI:
Bibkey:
Cite (ACL):
Tomasz Limisiewicz, David Mareček, and Tomáš Musil. 2025. Dual Debiasing: Remove Stereotypes and Keep Factual Gender for Fair Language Modeling and Translation. In Proceedings of the 18th International Natural Language Generation Conference, pages 148–164, Hanoi, Vietnam. Association for Computational Linguistics.
Cite (Informal):
Dual Debiasing: Remove Stereotypes and Keep Factual Gender for Fair Language Modeling and Translation (Limisiewicz et al., INLG 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-you-zhang-rochester/2025.inlg-main.10.pdf