A Multi-Task Incremental Learning Framework with Category Name Embedding for Aspect-Category Sentiment Analysis

Zehui Dai, Cheng Peng, Huajie Chen, Yadong Ding


Abstract
(T)ACSA tasks, including aspect-category sentiment analysis (ACSA) and targeted aspect-category sentiment analysis (TACSA), aims at identifying sentiment polarity on predefined categories. Incremental learning on new categories is necessary for (T)ACSA real applications. Though current multi-task learning models achieve good performance in (T)ACSA tasks, they suffer from catastrophic forgetting problems in (T)ACSA incremental learning tasks. In this paper, to make multi-task learning feasible for incremental learning, we proposed Category Name Embedding network (CNE-net). We set both encoder and decoder shared among all categories to weaken the catastrophic forgetting problem. Besides the origin input sentence, we applied another input feature, i.e., category name, for task discrimination. Our model achieved state-of-the-art on two (T)ACSA benchmark datasets. Furthermore, we proposed a dataset for (T)ACSA incremental learning and achieved the best performance compared with other strong baselines.
Anthology ID:
2020.emnlp-main.565
Volume:
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Month:
November
Year:
2020
Address:
Online
Editors:
Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6955–6965
Language:
URL:
https://aclanthology.org/2020.emnlp-main.565
DOI:
10.18653/v1/2020.emnlp-main.565
Bibkey:
Cite (ACL):
Zehui Dai, Cheng Peng, Huajie Chen, and Yadong Ding. 2020. A Multi-Task Incremental Learning Framework with Category Name Embedding for Aspect-Category Sentiment Analysis. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 6955–6965, Online. Association for Computational Linguistics.
Cite (Informal):
A Multi-Task Incremental Learning Framework with Category Name Embedding for Aspect-Category Sentiment Analysis (Dai et al., EMNLP 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/dois-2013-emnlp/2020.emnlp-main.565.pdf
Optional supplementary material:
 2020.emnlp-main.565.OptionalSupplementaryMaterial.zip
Video:
 https://slideslive.com/38938865
Code
 flak300S/emnlp2020_CNE-net
Data
SemEval-2014 Task-4