Bridging Modality Gap for Effective Multimodal Sentiment Analysis in Fashion-related Social Media
Zheyu Zhao, Zhongqing Wang, Shichen Li, Hongling Wang, Guodong Zhou
Abstract
Multimodal sentiment analysis for fashion-related social media is essential for understanding how consumers appraise fashion products across platforms like Instagram and Twitter, where both textual and visual elements contribute to sentiment expression. However, a notable challenge in this task is the modality gap, where the different information density between text and images hinders effective sentiment analysis. In this paper, we propose a novel multimodal framework that addresses this challenge by introducing pseudo data generated by a two-stage framework. We further utilize a multimodal fusion approach that efficiently integrates the information from various modalities for sentiment classification of fashion posts. Experiments conducted on a comprehensive dataset demonstrate that our framework significantly outperforms existing unimodal and multimodal baselines, highlighting its effectiveness in bridging the modality gap for more accurate sentiment classification in fashion-related social media posts.- Anthology ID:
- 2025.coling-main.123
- Volume:
- Proceedings of the 31st International Conference on Computational Linguistics
- Month:
- January
- Year:
- 2025
- Address:
- Abu Dhabi, UAE
- Editors:
- Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
- Venue:
- COLING
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1813–1823
- Language:
- URL:
- https://preview.aclanthology.org/fix-sig-urls/2025.coling-main.123/
- DOI:
- Cite (ACL):
- Zheyu Zhao, Zhongqing Wang, Shichen Li, Hongling Wang, and Guodong Zhou. 2025. Bridging Modality Gap for Effective Multimodal Sentiment Analysis in Fashion-related Social Media. In Proceedings of the 31st International Conference on Computational Linguistics, pages 1813–1823, Abu Dhabi, UAE. Association for Computational Linguistics.
- Cite (Informal):
- Bridging Modality Gap for Effective Multimodal Sentiment Analysis in Fashion-related Social Media (Zhao et al., COLING 2025)
- PDF:
- https://preview.aclanthology.org/fix-sig-urls/2025.coling-main.123.pdf