Innovative Semi-Automatic Methodology to Annotate Emotional Corpora

Lea Canales, Carlo Strapparava, Ester Boldrini, Patricio Martínez-Barco

Abstract
Detecting depression or personality traits, tutoring and student behaviour systems, or identifying cases of cyber-bulling are a few of the wide range of the applications, in which the automatic detection of emotion is a crucial element. Emotion detection has the potential of high impact by contributing the benefit of business, society, politics or education. Given this context, the main objective of our research is to contribute to the resolution of one of the most important challenges in textual emotion detection task: the problems of emotional corpora annotation. This will be tackled by proposing of a new semi-automatic methodology. Our innovative methodology consists in two main phases: (1) an automatic process to pre-annotate the unlabelled sentences with a reduced number of emotional categories; and (2) a refinement manual process where human annotators will determine which is the predominant emotion between the emotional categories selected in the phase 1. Our proposal in this paper is to show and evaluate the pre-annotation process to analyse the feasibility and the benefits by the methodology proposed. The results obtained are promising and allow obtaining a substantial improvement of annotation time and cost and confirm the usefulness of our pre-annotation process to improve the annotation task.
Anthology ID:
W16-4310
Volume:
Proceedings of the Workshop on Computational Modeling of People’s Opinions, Personality, and Emotions in Social Media (PEOPLES)
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Malvina Nissim, Viviana Patti, Barbara Plank
Venue:
PEOPLES
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
91–100
Language:
URL:
https://aclanthology.org/W16-4310
DOI:
Bibkey:
Cite (ACL):
Lea Canales, Carlo Strapparava, Ester Boldrini, and Patricio Martínez-Barco. 2016. Innovative Semi-Automatic Methodology to Annotate Emotional Corpora. In Proceedings of the Workshop on Computational Modeling of People’s Opinions, Personality, and Emotions in Social Media (PEOPLES), pages 91–100, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Innovative Semi-Automatic Methodology to Annotate Emotional Corpora (Canales et al., PEOPLES 2016)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp-22-attachments/W16-4310.pdf
PDF Search