Beyond Polarity: Continuous Affect-Enhanced Multimodal Aspect-Based Sentiment Classification
Ling-Ang Meng, Tianyu Zhao, Dawei Song, Jingxu Cao, Youhui Zuo
Abstract
Multimodal aspect-based sentiment classification (MABSC) requires aspect-level sentiment inference from textual-image data that jointly convey opinions. Yet most existing approaches primarily exploit discrete polarity patterns and generic visual embeddings, making them less effective when the affect is subtle, implicit, or expressed through imagery. In this work, we propose VADE, a Valence–Arousal–Dominance~(VAD)-Enhanced MABSC framework that brings continuous VAD signals into multimodal sentiment reasoning and learns emotion-sensitive image representations. Specifically, we design a VAD encoder to extract continuous affect cues from text for aspect-level sentiment reasoning. Furthermore, we fine-tune a CLIP-based image encoder on affect-enriched image–text pairs to obtain visual representations that are more sensitive to sentiment cues. To support the fine-tuning process, we construct an affect-enriched image–text dataset Senti-COCO by rewriting MSCOCO captions with a multimodal large language model, which yields large-scale image-text pairs with richer affective expressions. Experiments on two mainstream datasets, Twitter-15 and Twitter-17, show that VADE achieves a new state-of-the-art performance, demonstrating the effectiveness of incorporating VAD signals for MABSC.- Anthology ID:
- 2026.findings-acl.1979
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 39717–39727
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1979/
- DOI:
- Cite (ACL):
- Ling-Ang Meng, Tianyu Zhao, Dawei Song, Jingxu Cao, and Youhui Zuo. 2026. Beyond Polarity: Continuous Affect-Enhanced Multimodal Aspect-Based Sentiment Classification. In Findings of the Association for Computational Linguistics: ACL 2026, pages 39717–39727, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- Beyond Polarity: Continuous Affect-Enhanced Multimodal Aspect-Based Sentiment Classification (Meng et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1979.pdf