Beyond Polarity: Continuous Affect-Enhanced Multimodal Aspect-Based Sentiment Classification

Ling-Ang Meng, Tianyu Zhao, Dawei Song, Jingxu Cao, Youhui Zuo


Abstract
Multimodal aspect-based sentiment classification (MABSC) requires aspect-level sentiment inference from textual-image data that jointly convey opinions. Yet most existing approaches primarily exploit discrete polarity patterns and generic visual embeddings, making them less effective when the affect is subtle, implicit, or expressed through imagery. In this work, we propose VADE, a Valence–Arousal–Dominance~(VAD)-Enhanced MABSC framework that brings continuous VAD signals into multimodal sentiment reasoning and learns emotion-sensitive image representations. Specifically, we design a VAD encoder to extract continuous affect cues from text for aspect-level sentiment reasoning. Furthermore, we fine-tune a CLIP-based image encoder on affect-enriched image–text pairs to obtain visual representations that are more sensitive to sentiment cues. To support the fine-tuning process, we construct an affect-enriched image–text dataset Senti-COCO by rewriting MSCOCO captions with a multimodal large language model, which yields large-scale image-text pairs with richer affective expressions. Experiments on two mainstream datasets, Twitter-15 and Twitter-17, show that VADE achieves a new state-of-the-art performance, demonstrating the effectiveness of incorporating VAD signals for MABSC.
Anthology ID:
2026.findings-acl.1979
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
39717–39727
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1979/
DOI:
Bibkey:
Cite (ACL):
Ling-Ang Meng, Tianyu Zhao, Dawei Song, Jingxu Cao, and Youhui Zuo. 2026. Beyond Polarity: Continuous Affect-Enhanced Multimodal Aspect-Based Sentiment Classification. In Findings of the Association for Computational Linguistics: ACL 2026, pages 39717–39727, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Beyond Polarity: Continuous Affect-Enhanced Multimodal Aspect-Based Sentiment Classification (Meng et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1979.pdf
Checklist:
 2026.findings-acl.1979.checklist.pdf