Abstract
Debiasing methods in NLP models traditionally focus on isolating information related to a sensitive attribute (e.g., gender or race). We instead argue that a favorable debiasing method should use sensitive information ‘fairly,’ with explanations, rather than blindly eliminating it. This fair balance is often subjective and can be challenging to achieve algorithmically. We explore two interactive setups with a frozen predictive model and show that users able to provide feedback can achieve a better and fairer balance between task performance and bias mitigation. In one setup, users, by interacting with test examples, further decreased bias in the explanations (5-8%) while maintaining the same prediction accuracy. In the other setup, human feedback was able to disentangle associated bias and predictive information from the input leading to superior bias mitigation and improved task performance (4-5%) simultaneously.- Anthology ID:
- 2023.emnlp-main.589
- Volume:
- Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Month:
- December
- Year:
- 2023
- Address:
- Singapore
- Editors:
- Houda Bouamor, Juan Pino, Kalika Bali
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 9466–9471
- Language:
- URL:
- https://aclanthology.org/2023.emnlp-main.589
- DOI:
- 10.18653/v1/2023.emnlp-main.589
- Cite (ACL):
- Bodhisattwa Majumder, Zexue He, and Julian McAuley. 2023. InterFair: Debiasing with Natural Language Feedback for Fair Interpretable Predictions. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 9466–9471, Singapore. Association for Computational Linguistics.
- Cite (Informal):
- InterFair: Debiasing with Natural Language Feedback for Fair Interpretable Predictions (Majumder et al., EMNLP 2023)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/2023.emnlp-main.589.pdf