Abstract
Due to the development of modern computer technology and the increase in the number of online media users, we can see all kinds of posts and comments everywhere on the internet. Hope speech can not only inspire the creators but also make other viewers pleasant. It is necessary to effectively and automatically detect hope speech. This paper describes the approach of our team in the task of hope speech detection. We use the attention mechanism to adjust the weight of all the output layers of XLM-RoBERTa to make full use of the information extracted from each layer, and use the weighted sum of all the output layers to complete the classification task. And we use the Stratified-K-Fold method to enhance the training data set. We achieve a weighted average F1-score of 0.59, 0.84, and 0.92 for Tamil, Malayalam, and English language, ranked 3rd, 2nd, and 2nd.- Anthology ID:
- 2021.ltedi-1.16
- Volume:
- Proceedings of the First Workshop on Language Technology for Equality, Diversity and Inclusion
- Month:
- April
- Year:
- 2021
- Address:
- Kyiv
- Editors:
- Bharathi Raja Chakravarthi, John P. McCrae, Manel Zarrouk, Kalika Bali, Paul Buitelaar
- Venue:
- LTEDI
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 118–121
- Language:
- URL:
- https://aclanthology.org/2021.ltedi-1.16
- DOI:
- Cite (ACL):
- Yingjia Zhao and Xin Tao. 2021. ZYJ@LT-EDI-EACL2021:XLM-RoBERTa-Based Model with Attention for Hope Speech Detection. In Proceedings of the First Workshop on Language Technology for Equality, Diversity and Inclusion, pages 118–121, Kyiv. Association for Computational Linguistics.
- Cite (Informal):
- ZYJ@LT-EDI-EACL2021:XLM-RoBERTa-Based Model with Attention for Hope Speech Detection (Zhao & Tao, LTEDI 2021)
- PDF:
- https://preview.aclanthology.org/dois-2013-emnlp/2021.ltedi-1.16.pdf