Sarcasm Detection Using an Ensemble Approach

Jens Lemmens, Ben Burtenshaw, Ehsan Lotfi, Ilia Markov, Walter Daelemans


Abstract
We present an ensemble approach for the detection of sarcasm in Reddit and Twitter responses in the context of The Second Workshop on Figurative Language Processing held in conjunction with ACL 2020. The ensemble is trained on the predicted sarcasm probabilities of four component models and on additional features, such as the sentiment of the comment, its length, and source (Reddit or Twitter) in order to learn which of the component models is the most reliable for which input. The component models consist of an LSTM with hashtag and emoji representations; a CNN-LSTM with casing, stop word, punctuation, and sentiment representations; an MLP based on Infersent embeddings; and an SVM trained on stylometric and emotion-based features. All component models use the two conversational turns preceding the response as context, except for the SVM, which only uses features extracted from the response. The ensemble itself consists of an adaboost classifier with the decision tree algorithm as base estimator and yields F1-scores of 67% and 74% on the Reddit and Twitter test data, respectively.
Anthology ID:
2020.figlang-1.36
Volume:
Proceedings of the Second Workshop on Figurative Language Processing
Month:
July
Year:
2020
Address:
Online
Editors:
Beata Beigman Klebanov, Ekaterina Shutova, Patricia Lichtenstein, Smaranda Muresan, Chee Wee, Anna Feldman, Debanjan Ghosh
Venue:
Fig-Lang
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
264–269
Language:
URL:
https://aclanthology.org/2020.figlang-1.36
DOI:
10.18653/v1/2020.figlang-1.36
Bibkey:
Cite (ACL):
Jens Lemmens, Ben Burtenshaw, Ehsan Lotfi, Ilia Markov, and Walter Daelemans. 2020. Sarcasm Detection Using an Ensemble Approach. In Proceedings of the Second Workshop on Figurative Language Processing, pages 264–269, Online. Association for Computational Linguistics.
Cite (Informal):
Sarcasm Detection Using an Ensemble Approach (Lemmens et al., Fig-Lang 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-2/2020.figlang-1.36.pdf
Video:
 http://slideslive.com/38929694