Automated Detection of Cyberbullying Against Women and Immigrants and Cross-domain Adaptability
Thushari Atapattu, Mahen Herath, Georgia Zhang, Katrina Falkner
Abstract
Cyberbullying is a prevalent and growing social problem due to the surge of social media technology usage. Minorities, women, and adolescents are among the common victims of cyberbullying. Despite the advancement of NLP technologies, the automated cyberbullying detection remains challenging. This paper focuses on advancing the technology using state-of-the-art NLP techniques. We use a Twitter dataset from SemEval 2019 - Task 5 (HatEval) on hate speech against women and immigrants. Our best performing ensemble model based on DistiBERT has achieved 0.73 and 0.74 of F1 score in the task of classifying hate speech (Task A) and aggressiveness and target (Task B) respectively. We adapt the ensemble model developed for Task A to classify offensive language in external datasets and achieved ~0.7 of F1 score using three benchmark datasets, enabling promising results for cross-domain adaptability. We conduct a qualitative analysis of misclassified tweets to provide insightful recommendations for future cyberbullying research.- Anthology ID:
- 2020.alta-1.2
- Volume:
- Proceedings of the The 18th Annual Workshop of the Australasian Language Technology Association
- Month:
- December
- Year:
- 2020
- Address:
- Virtual Workshop
- Editors:
- Maria Kim, Daniel Beck, Meladel Mistica
- Venue:
- ALTA
- SIG:
- Publisher:
- Australasian Language Technology Association
- Note:
- Pages:
- 11–20
- Language:
- URL:
- https://aclanthology.org/2020.alta-1.2
- DOI:
- Cite (ACL):
- Thushari Atapattu, Mahen Herath, Georgia Zhang, and Katrina Falkner. 2020. Automated Detection of Cyberbullying Against Women and Immigrants and Cross-domain Adaptability. In Proceedings of the The 18th Annual Workshop of the Australasian Language Technology Association, pages 11–20, Virtual Workshop. Australasian Language Technology Association.
- Cite (Informal):
- Automated Detection of Cyberbullying Against Women and Immigrants and Cross-domain Adaptability (Atapattu et al., ALTA 2020)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/2020.alta-1.2.pdf