Abstract
Gender bias estimation and mitigation techniques in word embeddings lack an understanding of their generalization capabilities. In this work, we complement prior research by comparing in a systematic way four gender bias metrics (Word Embedding Association Tes, Relative Negative Sentiment Bias, Embedding Coherence Test and Bias Analogy Test), two types of projection-based gender mitigation strategies (hard- and soft-debiasing) on three well-known word embedding representations (Word2Vec, FastText and Glove). The experiments have shown that the considered word embeddings are consistent between them but the debiasing techniques are inconsistent across the different metrics, also highlighting the potential risk of unintended bias after the mitigation strategies.- Anthology ID:
- 2023.ranlp-1.38
- Volume:
- Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing
- Month:
- September
- Year:
- 2023
- Address:
- Varna, Bulgaria
- Editors:
- Ruslan Mitkov, Galia Angelova
- Venue:
- RANLP
- SIG:
- Publisher:
- INCOMA Ltd., Shoumen, Bulgaria
- Note:
- Pages:
- 336–343
- Language:
- URL:
- https://aclanthology.org/2023.ranlp-1.38
- DOI:
- Cite (ACL):
- Elisabetta Fersini, Antonio Candelieri, and Lorenzo Pastore. 2023. On the Generalization of Projection-Based Gender Debiasing in Word Embedding. In Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing, pages 336–343, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
- Cite (Informal):
- On the Generalization of Projection-Based Gender Debiasing in Word Embedding (Fersini et al., RANLP 2023)
- PDF:
- https://preview.aclanthology.org/proper-vol2-ingestion/2023.ranlp-1.38.pdf