Semantic Differentiation in Speech Emotion Recognition: Insights from Descriptive and Expressive Speech Roles

Rongchen Guo, Vincent Francoeur, Isar Nejadgholi, Sylvain Gagnon, Miodrag Bolic


Abstract
Speech Emotion Recognition (SER) is essential for improving human-computer interaction, yet its accuracy remains constrained by the complexity of emotional nuances in speech. In this study, we distinguish between descriptive\ semantics, which represents the contextual content of speech, and expressive\ semantics, which reflects the speaker’s emotional state. After watching emotionally charged movie segments, we recorded audio clips of participants describing their experiences, along with the intended emotion tags for each clip, participants’ self-rated emotional responses, and their valence/arousal scores. Through experiments we show that descriptive semantics align with intended emotions, while expressive semantics correlate with evoked emotions. Our findings inform SER applications in human-AI interaction and pave the way for more context-aware AI systems.
Anthology ID:
2025.starsem-1.6
Volume:
Proceedings of the 14th Joint Conference on Lexical and Computational Semantics (*SEM 2025)
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Lea Frermann, Mark Stevenson
Venue:
*SEM
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
70–82
Language:
URL:
https://preview.aclanthology.org/ingest-emnlp/2025.starsem-1.6/
DOI:
Bibkey:
Cite (ACL):
Rongchen Guo, Vincent Francoeur, Isar Nejadgholi, Sylvain Gagnon, and Miodrag Bolic. 2025. Semantic Differentiation in Speech Emotion Recognition: Insights from Descriptive and Expressive Speech Roles. In Proceedings of the 14th Joint Conference on Lexical and Computational Semantics (*SEM 2025), pages 70–82, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Semantic Differentiation in Speech Emotion Recognition: Insights from Descriptive and Expressive Speech Roles (Guo et al., *SEM 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-emnlp/2025.starsem-1.6.pdf