Can Emotion Carriers Explain Automatic Sentiment Prediction? A Study on Personal Narratives
Seyed Mahed Mousavi, Gabriel Roccabruna, Aniruddha Tammewar, Steve Azzolin, Giuseppe Riccardi
Abstract
Deep Neural Networks (DNN) models have achieved acceptable performance in sentiment prediction of written text. However, the output of these machine learning (ML) models cannot be natively interpreted. In this paper, we study how the sentiment polarity predictions by DNNs can be explained and compare them to humans’ explanations. We crowdsource a corpus of Personal Narratives and ask human judges to annotate them with polarity and select the corresponding token chunks - the Emotion Carriers (EC) - that convey narrators’ emotions in the text. The interpretations of ML neural models are carried out through Integrated Gradients method and we compare them with human annotators’ interpretations. The results of our comparative analysis indicate that while the ML model mostly focuses on the explicit appearance of emotions-laden words (e.g. happy, frustrated), the human annotator predominantly focuses the attention on the manifestation of emotions through ECs that denote events, persons, and objects which activate narrator’s emotional state.- Anthology ID:
- 2022.wassa-1.6
- Volume:
- Proceedings of the 12th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland
- Editors:
- Jeremy Barnes, Orphée De Clercq, Valentin Barriere, Shabnam Tafreshi, Sawsan Alqahtani, João Sedoc, Roman Klinger, Alexandra Balahur
- Venue:
- WASSA
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 62–70
- Language:
- URL:
- https://aclanthology.org/2022.wassa-1.6
- DOI:
- 10.18653/v1/2022.wassa-1.6
- Cite (ACL):
- Seyed Mahed Mousavi, Gabriel Roccabruna, Aniruddha Tammewar, Steve Azzolin, and Giuseppe Riccardi. 2022. Can Emotion Carriers Explain Automatic Sentiment Prediction? A Study on Personal Narratives. In Proceedings of the 12th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis, pages 62–70, Dublin, Ireland. Association for Computational Linguistics.
- Cite (Informal):
- Can Emotion Carriers Explain Automatic Sentiment Prediction? A Study on Personal Narratives (Mousavi et al., WASSA 2022)
- PDF:
- https://preview.aclanthology.org/naacl24-info/2022.wassa-1.6.pdf
- Code
- sislab/pns_val-ec_annotation