Emoji-Based Transfer Learning for Sentiment Tasks

Susann Boy, Dana Ruiter, Dietrich Klakow


Abstract
Sentiment tasks such as hate speech detection and sentiment analysis, especially when performed on languages other than English, are often low-resource. In this study, we exploit the emotional information encoded in emojis to enhance the performance on a variety of sentiment tasks. This is done using a transfer learning approach, where the parameters learned by an emoji-based source task are transferred to a sentiment target task. We analyse the efficacy of the transfer under three conditions, i.e. i) the emoji content and ii) label distribution of the target task as well as iii) the difference between monolingually and multilingually learned source tasks. We find i.a. that the transfer is most beneficial if the target task is balanced with high emoji content. Monolingually learned source tasks have the benefit of taking into account the culturally specific use of emojis and gain up to F1 +0.280 over the baseline.
Anthology ID:
2021.eacl-srw.15
Volume:
Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop
Month:
April
Year:
2021
Address:
Online
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
103–110
Language:
URL:
https://aclanthology.org/2021.eacl-srw.15
DOI:
10.18653/v1/2021.eacl-srw.15
Bibkey:
Cite (ACL):
Susann Boy, Dana Ruiter, and Dietrich Klakow. 2021. Emoji-Based Transfer Learning for Sentiment Tasks. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop, pages 103–110, Online. Association for Computational Linguistics.
Cite (Informal):
Emoji-Based Transfer Learning for Sentiment Tasks (Boy et al., EACL 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/2021.eacl-srw.15.pdf
Code
 uds-lsv/emoji-transfer