Emotion Corpus Construction Based on Selection from Hashtags

Minglei Li, Yunfei Long, Lu Qin, Wenjie Li

Abstract
The availability of labelled corpus is of great importance for supervised learning in emotion classification tasks. Because it is time-consuming to manually label text, hashtags have been used as naturally annotated labels to obtain a large amount of labelled training data from microblog. However, natural hashtags contain too much noise for it to be used directly in learning algorithms. In this paper, we design a three-stage semi-automatic method to construct an emotion corpus from microblogs. Firstly, a lexicon based voting approach is used to verify the hashtag automatically. Secondly, a SVM based classifier is used to select the data whose natural labels are consistent with the predicted labels. Finally, the remaining data will be manually examined to filter out the noisy data. Out of about 48K filtered Chinese microblogs, 39k microblogs are selected to form the final corpus with the Kappa value reaching over 0.92 for the automatic parts and over 0.81 for the manual part. The proportion of automatic selection reaches 54.1%. Thus, the method can reduce about 44.5% of manual workload for acquiring quality data. Experiment on a classifier trained on this corpus shows that it achieves comparable results compared to the manually annotated NLP&CC2013 corpus.
Anthology ID:
L16-1291
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1845–1849
Language:
URL:
https://aclanthology.org/L16-1291
DOI:
Bibkey:
Cite (ACL):
Minglei Li, Yunfei Long, Lu Qin, and Wenjie Li. 2016. Emotion Corpus Construction Based on Selection from Hashtags. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 1845–1849, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Emotion Corpus Construction Based on Selection from Hashtags (Li et al., LREC 2016)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-dup-bibkey/L16-1291.pdf
PDF Search