Abstract
The popularity of sentiment and emotion analysis has lead to an explosion of datasets, approaches, and papers. However, these are often tested in optimal settings, where plentiful training and development data are available, and compared mainly with recent state-of-the-art models that have been similarly evaluated. In this paper, we instead present a systematic comparison of sentiment and emotion classification methods, ranging from rule- and dictionary-based methods to recently proposed few-shot and prompting methods with large language models. We test these methods in-domain, out-of-domain, and in cross-lingual settings and find that in low-resource settings, rule- and dictionary-based methods perform as well or better than few-shot and prompting methods, especially for emotion classification. Zero-shot cross-lingual approaches, however, still outperform in-language dictionary induction.- Anthology ID:
- 2023.wassa-1.26
- Volume:
- Proceedings of the 13th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Jeremy Barnes, Orphée De Clercq, Roman Klinger
- Venue:
- WASSA
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 290–304
- Language:
- URL:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2023.wassa-1.26/
- DOI:
- 10.18653/v1/2023.wassa-1.26
- Cite (ACL):
- Jeremy Barnes. 2023. Sentiment and Emotion Classification in Low-resource Settings. In Proceedings of the 13th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis, pages 290–304, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- Sentiment and Emotion Classification in Low-resource Settings (Barnes, WASSA 2023)
- PDF:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2023.wassa-1.26.pdf