Complaint Identification in Social Media with Transformer Networks

Mali Jin, Nikolaos Aletras


Abstract
Complaining is a speech act extensively used by humans to communicate a negative inconsistency between reality and expectations. Previous work on automatically identifying complaints in social media has focused on using feature-based and task-specific neural network models. Adapting state-of-the-art pre-trained neural language models and their combinations with other linguistic information from topics or sentiment for complaint prediction has yet to be explored. In this paper, we evaluate a battery of neural models underpinned by transformer networks which we subsequently combine with linguistic information. Experiments on a publicly available data set of complaints demonstrate that our models outperform previous state-of-the-art methods by a large margin achieving a macro F1 up to 87.
Anthology ID:
2020.coling-main.157
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Donia Scott, Nuria Bel, Chengqing Zong
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
1765–1771
Language:
URL:
https://aclanthology.org/2020.coling-main.157
DOI:
10.18653/v1/2020.coling-main.157
Bibkey:
Cite (ACL):
Mali Jin and Nikolaos Aletras. 2020. Complaint Identification in Social Media with Transformer Networks. In Proceedings of the 28th International Conference on Computational Linguistics, pages 1765–1771, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
Complaint Identification in Social Media with Transformer Networks (Jin & Aletras, COLING 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2020.coling-main.157.pdf