2024
pdf
abs
Overview of Third Shared Task on Homophobia and Transphobia Detection in Social Media Comments
Bharathi Raja Chakravarthi
|
Prasanna Kumaresan
|
Ruba Priyadharshini
|
Paul Buitelaar
|
Asha Hegde
|
Hosahalli Shashirekha
|
Saranya Rajiakodi
|
Miguel Ángel García
|
Salud María Jiménez-Zafra
|
José García-Díaz
|
Rafael Valencia-García
|
Kishore Ponnusamy
|
Poorvi Shetty
|
Daniel García-Baena
Proceedings of the Fourth Workshop on Language Technology for Equality, Diversity, Inclusion
This paper provides a comprehensive summary of the “Homophobia and Transphobia Detection in Social Media Comments” shared task, which was held at the LT-EDI@EACL 2024. The objective of this task was to develop systems capable of identifying instances of homophobia and transphobia within social media comments. This challenge was extended across ten languages: English, Tamil, Malayalam, Telugu, Kannada, Gujarati, Hindi, Marathi, Spanish, and Tulu. Each comment in the dataset was annotated into three categories. The shared task attracted significant interest, with over 60 teams participating through the CodaLab platform. The submission of prediction from the participants was evaluated with the macro F1 score.
2023
pdf
abs
Overview of the Shared Task on Hope Speech Detection for Equality, Diversity, and Inclusion
Prasanna Kumar Kumaresan
|
Bharathi Raja Chakravarthi
|
Subalalitha Cn
|
Miguel Ángel García-Cumbreras
|
Salud María Jiménez Zafra
|
José Antonio García-Díaz
|
Rafael Valencia-García
|
Momchil Hardalov
|
Ivan Koychev
|
Preslav Nakov
|
Daniel García-Baena
|
Kishore Kumar Ponnusamy
Proceedings of the Third Workshop on Language Technology for Equality, Diversity and Inclusion
Hope serves as a powerful driving force that encourages individuals to persevere in the face of the unpredictable nature of human existence. It instills motivation within us to remain steadfast in our pursuit of important goals, regardless of the uncertainties that lie ahead. In today’s digital age, platforms such as Facebook, Twitter, Instagram, and YouTube have emerged as prominent social media outlets where people freely express their views and opinions. These platforms have also become crucial for marginalized individuals seeking online assistance and support[1][2][3]. The outbreak of the pandemic has exacerbated people’s fears around the world, as they grapple with the possibility of losing loved ones and the lack of access to essential services such as schools, hospitals, and mental health facilities.
2022
pdf
abs
Overview of the Shared Task on Hope Speech Detection for Equality, Diversity, and Inclusion
Bharathi Raja Chakravarthi
|
Vigneshwaran Muralidaran
|
Ruba Priyadharshini
|
Subalalitha Cn
|
John McCrae
|
Miguel Ángel García
|
Salud María Jiménez-Zafra
|
Rafael Valencia-García
|
Prasanna Kumaresan
|
Rahul Ponnusamy
|
Daniel García-Baena
|
José García-Díaz
Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion
Hope Speech detection is the task of classifying a sentence as hope speech or non-hope speech given a corpus of sentences. Hope speech is any message or content that is positive, encouraging, reassuring, inclusive and supportive that inspires and engenders optimism in the minds of people. In contrast to identifying and censoring negative speech patterns, hope speech detection is focussed on recognising and promoting positive speech patterns online. In this paper, we report an overview of the findings and results from the shared task on hope speech detection for Tamil, Malayalam, Kannada, English and Spanish languages conducted in the second workshop on Language Technology for Equality, Diversity and Inclusion (LT-EDI-2022) organised as a part of ACL 2022. The participants were provided with annotated training & development datasets and unlabelled test datasets in all the five languages. The goal of the shared task is to classify the given sentences into one of the two hope speech classes. The performances of the systems submitted by the participants were evaluated in terms of micro-F1 score and weighted-F1 score. The datasets for this challenge are openly available