Gender Bias in Coreference Resolution
Rachel Rudinger, Jason Naradowsky, Brian Leonard, Benjamin Van Durme
Abstract
We present an empirical study of gender bias in coreference resolution systems. We first introduce a novel, Winograd schema-style set of minimal pair sentences that differ only by pronoun gender. With these “Winogender schemas,” we evaluate and confirm systematic gender bias in three publicly-available coreference resolution systems, and correlate this bias with real-world and textual gender statistics.- Anthology ID:
- N18-2002
- Volume:
- Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)
- Month:
- June
- Year:
- 2018
- Address:
- New Orleans, Louisiana
- Venue:
- NAACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 8–14
- Language:
- URL:
- https://aclanthology.org/N18-2002
- DOI:
- 10.18653/v1/N18-2002
- Cite (ACL):
- Rachel Rudinger, Jason Naradowsky, Brian Leonard, and Benjamin Van Durme. 2018. Gender Bias in Coreference Resolution. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 8–14, New Orleans, Louisiana. Association for Computational Linguistics.
- Cite (Informal):
- Gender Bias in Coreference Resolution (Rudinger et al., NAACL 2018)
- PDF:
- https://preview.aclanthology.org/ingestion-script-update/N18-2002.pdf
- Code
- rudinger/winogender-schemas + additional community code
- Data
- Winogender Schemas, WinoBias