SemEval-2023 Task 10: Explainable Detection of Online Sexism

Hannah Kirk, Wenjie Yin, Bertie Vidgen, Paul Röttger


Abstract
Online sexism is a widespread and harmful phenomenon. Automated tools can assist the detection of sexism at scale. Binary detection, however, disregards the diversity of sexist content, and fails to provide clear explanations for why something is sexist. To address this issue, we introduce SemEval Task 10 on the Explainable Detection of Online Sexism (EDOS). We make three main contributions: i) a novel hierarchical taxonomy of sexist content, which includes granular vectors of sexism to aid explainability; ii) a new dataset of 20,000 social media comments with fine-grained labels, along with larger unlabelled datasets for model adaptation; and iii) baseline models as well as an analysis of the methods, results and errors for participant submissions to our task.
Anthology ID:
2023.semeval-1.305
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
2193–2210
Language:
URL:
https://aclanthology.org/2023.semeval-1.305
DOI:
10.18653/v1/2023.semeval-1.305
Bibkey:
Cite (ACL):
Hannah Kirk, Wenjie Yin, Bertie Vidgen, and Paul Röttger. 2023. SemEval-2023 Task 10: Explainable Detection of Online Sexism. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 2193–2210, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
SemEval-2023 Task 10: Explainable Detection of Online Sexism (Kirk et al., SemEval 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/landing_page/2023.semeval-1.305.pdf
Video:
 https://preview.aclanthology.org/landing_page/2023.semeval-1.305.mp4