Overview of the Shared Task on Hope Speech Detection for Equality, Diversity, and Inclusion
Bharathi Raja Chakravarthi, Vigneshwaran Muralidaran, Ruba Priyadharshini, Subalalitha Cn, John McCrae, Miguel Ángel García, Salud María Jiménez-Zafra, Rafael Valencia-García, Prasanna Kumaresan, Rahul Ponnusamy, Daniel García-Baena, José García-Díaz
Abstract
Hope Speech detection is the task of classifying a sentence as hope speech or non-hope speech given a corpus of sentences. Hope speech is any message or content that is positive, encouraging, reassuring, inclusive and supportive that inspires and engenders optimism in the minds of people. In contrast to identifying and censoring negative speech patterns, hope speech detection is focussed on recognising and promoting positive speech patterns online. In this paper, we report an overview of the findings and results from the shared task on hope speech detection for Tamil, Malayalam, Kannada, English and Spanish languages conducted in the second workshop on Language Technology for Equality, Diversity and Inclusion (LT-EDI-2022) organised as a part of ACL 2022. The participants were provided with annotated training & development datasets and unlabelled test datasets in all the five languages. The goal of the shared task is to classify the given sentences into one of the two hope speech classes. The performances of the systems submitted by the participants were evaluated in terms of micro-F1 score and weighted-F1 score. The datasets for this challenge are openly available- Anthology ID:
- 2022.ltedi-1.58
- Volume:
- Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland
- Editors:
- Bharathi Raja Chakravarthi, B Bharathi, John P McCrae, Manel Zarrouk, Kalika Bali, Paul Buitelaar
- Venue:
- LTEDI
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 378–388
- Language:
- URL:
- https://aclanthology.org/2022.ltedi-1.58
- DOI:
- 10.18653/v1/2022.ltedi-1.58
- Cite (ACL):
- Bharathi Raja Chakravarthi, Vigneshwaran Muralidaran, Ruba Priyadharshini, Subalalitha Cn, John McCrae, Miguel Ángel García, Salud María Jiménez-Zafra, Rafael Valencia-García, Prasanna Kumaresan, Rahul Ponnusamy, Daniel García-Baena, and José García-Díaz. 2022. Overview of the Shared Task on Hope Speech Detection for Equality, Diversity, and Inclusion. In Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion, pages 378–388, Dublin, Ireland. Association for Computational Linguistics.
- Cite (Informal):
- Overview of the Shared Task on Hope Speech Detection for Equality, Diversity, and Inclusion (Chakravarthi et al., LTEDI 2022)
- PDF:
- https://preview.aclanthology.org/proper-vol2-ingestion/2022.ltedi-1.58.pdf