Evaluating Aggression Identification in Social Media
Ritesh Kumar, Atul Kr. Ojha, Shervin Malmasi, Marcos Zampieri
Abstract
In this paper, we present the report and findings of the Shared Task on Aggression and Gendered Aggression Identification organised as part of the Second Workshop on Trolling, Aggression and Cyberbullying (TRAC - 2) at LREC 2020. The task consisted of two sub-tasks - aggression identification (sub-task A) and gendered identification (sub-task B) - in three languages - Bangla, Hindi and English. For this task, the participants were provided with a dataset of approximately 5,000 instances from YouTube comments in each language. For testing, approximately 1,000 instances were provided in each language for each sub-task. A total of 70 teams registered to participate in the task and 19 teams submitted their test runs. The best system obtained a weighted F-score of approximately 0.80 in sub-task A for all the three languages. While approximately 0.87 in sub-task B for all the three languages.- Anthology ID:
- 2020.trac-1.1
- Volume:
- Proceedings of the Second Workshop on Trolling, Aggression and Cyberbullying
- Month:
- May
- Year:
- 2020
- Address:
- Marseille, France
- Editors:
- Ritesh Kumar, Atul Kr. Ojha, Bornini Lahiri, Marcos Zampieri, Shervin Malmasi, Vanessa Murdock, Daniel Kadar
- Venue:
- TRAC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 1–5
- Language:
- English
- URL:
- https://aclanthology.org/2020.trac-1.1
- DOI:
- Cite (ACL):
- Ritesh Kumar, Atul Kr. Ojha, Shervin Malmasi, and Marcos Zampieri. 2020. Evaluating Aggression Identification in Social Media. In Proceedings of the Second Workshop on Trolling, Aggression and Cyberbullying, pages 1–5, Marseille, France. European Language Resources Association (ELRA).
- Cite (Informal):
- Evaluating Aggression Identification in Social Media (Kumar et al., TRAC 2020)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/2020.trac-1.1.pdf