Real-Time Mitigation of Negative Emotion in Customer Care Calls

Surupendu Gangopadhyay, Mahnoosh Mehrabani


Abstract
Speech emotion recognition (SER) is a compelling yet challenging research area with substantial practical relevance, particularly in enhancing human–machine interaction. Despite considerable progress in the field, the scarcity of realistic datasets that reflect real-world conditions makes it difficult to analyze system behavior in practice and can lead to degraded performance in industrial applications. In this study, we propose a system that detects negative emotions at each turn in a conversation by leveraging both linguistic and acoustic features. The approach is evaluated on real-world data, with a particular focus on identifying and responding to negative emotion in customer support scenarios. Designed for real-time application, the system is suitable for live deployment in call center environments. Furthermore, we propose an effective prompting strategy for using large language models (LLMs) as annotators, generating labeled data used to fine-tune small language models that achieve performance on par with the LLM used for annotation, while remaining suitable for real-time deployment.
Anthology ID:
2026.wassa-1.19
Volume:
The Proceedings for the 15th Workshop on Computational Approaches to Subjectivity, Sentiment Social Media Analysis (WASSA 2026)
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Jeremy Barnes, Valentin Barriere, Orphée De Clercq, Roman Klinger, Célia Nouri, Debora Nozza, Pranaydeep Singh
Venues:
WASSA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
252–264
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.wassa-1.19/
DOI:
Bibkey:
Cite (ACL):
Surupendu Gangopadhyay and Mahnoosh Mehrabani. 2026. Real-Time Mitigation of Negative Emotion in Customer Care Calls. In The Proceedings for the 15th Workshop on Computational Approaches to Subjectivity, Sentiment Social Media Analysis (WASSA 2026), pages 252–264, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
Real-Time Mitigation of Negative Emotion in Customer Care Calls (Gangopadhyay & Mehrabani, WASSA 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.wassa-1.19.pdf