Mitigating Gender Bias in Job Ranking Systems Using Job Advertisement Neutrality

Deepak Kumar, Shahed Masoudian, Alessandro B. Melchiorre, Markus Schedl


Abstract
Transformer-based Job Ranking Systems (JRSs) are vulnerable to societal biases inherited in unbalanced datasets. These biases often manifest as unjust job rankings, particularly disadvantaging candidates of different genders. Most bias mitigation techniques leverage candidates’ gender and align gender distributions within the embeddings of JRSs to mitigate bias. While such methods effectively align distributional properties and make JRSs agnostic to gender, they frequently fall short in addressing empirical fairness metrics, such as the performance gap across genders. In this study, we shift our attention from candidate gender to mitigate bias based on gendered language in job advertisements. We propose a novel neutrality score based on automatically discovered biased words in job ads and use it to re-rank the model’s decisions. We evaluate our method by comparing it with different bias mitigation strategies and empirically demonstrate that our proposed method not only improves fairness but can also enhance the model’s performance.
Anthology ID:
2025.nlp4pi-1.23
Volume:
Proceedings of the Fourth Workshop on NLP for Positive Impact (NLP4PI)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Katherine Atwell, Laura Biester, Angana Borah, Daryna Dementieva, Oana Ignat, Neema Kotonya, Ziyi Liu, Ruyuan Wan, Steven Wilson, Jieyu Zhao
Venues:
NLP4PI | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
264–271
Language:
URL:
https://preview.aclanthology.org/landing_page/2025.nlp4pi-1.23/
DOI:
Bibkey:
Cite (ACL):
Deepak Kumar, Shahed Masoudian, Alessandro B. Melchiorre, and Markus Schedl. 2025. Mitigating Gender Bias in Job Ranking Systems Using Job Advertisement Neutrality. In Proceedings of the Fourth Workshop on NLP for Positive Impact (NLP4PI), pages 264–271, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Mitigating Gender Bias in Job Ranking Systems Using Job Advertisement Neutrality (Kumar et al., NLP4PI 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/landing_page/2025.nlp4pi-1.23.pdf