Abstract
Prior research has discussed and illustrated the need to consider linguistic norms at the community level when studying taboo (hateful/offensive/toxic etc.) language. However, a methodology for doing so, that is firmly founded on community language norms is still largely absent. This can lead both to biases in taboo text classification and limitations in our understanding of the causes of bias. We propose a method to study bias in taboo classification and annotation where a community perspective is front and center. This is accomplished by using special classifiers tuned for each community’s language. In essence, these classifiers represent community level language norms. We use these to study bias and find, for example, biases are largest against African Americans (7/10 datasets and all 3 classifiers examined). In contrast to previous papers we also study other communities and find, for example, strong biases against South Asians. In a small scale user study we illustrate our key idea which is that common utterances, i.e., those with high alignment scores with a community (community classifier confidence scores) are unlikely to be regarded taboo. Annotators who are community members contradict taboo classification decisions and annotations in a majority of instances. This paper is a significant step toward reducing false positive taboo decisions that over time harm minority communities.- Anthology ID:
- 2022.findings-acl.227
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2022
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland
- Editors:
- Smaranda Muresan, Preslav Nakov, Aline Villavicencio
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2883–2896
- Language:
- URL:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2022.findings-acl.227/
- DOI:
- 10.18653/v1/2022.findings-acl.227
- Cite (ACL):
- Osama Khalid, Jonathan Rusert, and Padmini Srinivasan. 2022. Suum Cuique: Studying Bias in Taboo Detection with a Community Perspective. In Findings of the Association for Computational Linguistics: ACL 2022, pages 2883–2896, Dublin, Ireland. Association for Computational Linguistics.
- Cite (Informal):
- Suum Cuique: Studying Bias in Taboo Detection with a Community Perspective (Khalid et al., Findings 2022)
- PDF:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2022.findings-acl.227.pdf
- Code
- jonrusert/suumcuique
- Data
- OLID