An Analysis of Abusive Language Data Collected through a Game with a Purpose

Federico Bonetti, Sara Tonelli


Abstract
In this work we present an analysis of abusive language annotations collected through a 3D video game. With this approach, we are able to involve in the annotation teenagers, i.e. typical targets of cyberbullying, whose data are usually not available for research purposes. Using the game in the framework of educational activities to empower teenagers against online abuse we are able to obtain insights into how teenagers communicate, and what kind of messages they consider more offensive. While players produced interesting annotations and the distributions of classes between players and experts are similar, we obtained a significant number of mismatching judgements between experts and players.
Anthology ID:
2022.games-1.1
Volume:
Proceedings of the 9th Workshop on Games and Natural Language Processing within the 13th Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editor:
Chris Madge
Venue:
games
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
1–6
Language:
URL:
https://aclanthology.org/2022.games-1.1
DOI:
Bibkey:
Cite (ACL):
Federico Bonetti and Sara Tonelli. 2022. An Analysis of Abusive Language Data Collected through a Game with a Purpose. In Proceedings of the 9th Workshop on Games and Natural Language Processing within the 13th Language Resources and Evaluation Conference, pages 1–6, Marseille, France. European Language Resources Association.
Cite (Informal):
An Analysis of Abusive Language Data Collected through a Game with a Purpose (Bonetti & Tonelli, games 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/autopr/2022.games-1.1.pdf