Uncertainty-Calibrated Elastic Alignment for Multimodal Sentiment Analysis with Missing Modalities

Kang He, Yuzhe Ding, Rao Fu, Yukang Feng, Kaipeng Zhang, Yiming Liu, Fei Li, Chong Teng, Donghong Ji


Abstract
Multimodal sentiment analysis (MSA) in real-world scenarios is often challenged by dynamically missing modalities. Existing methods predominantly rely on deterministic imputation and rigid alignment, which compels the model to overfit noise in ambiguous regions while neglecting the decision shift induced by modality inertia. To address these issues, we propose a novel uncertainty-calibrated elastic alignment framework, termed EASE. Specifically, we employ probabilistic imputation to capture cross-modal ambiguity and leverage the estimated uncertainty to drive elastic alignment, thereby adaptively relaxing constraints in ambiguous regions to avoid rigid fitting. Meanwhile, we introduce cross-view predictive consistency constraints to unify discriminative logic across different modality views, stabilizing the decision boundary under modality degradation. Extensive experiments demonstrate that EASE consistently outperforms existing state-of-the-art baselines across multiple benchmarks, exhibiting exceptional robustness particularly under high missing-rate scenarios.
Anthology ID:
2026.findings-acl.260
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5268–5288
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.260/
DOI:
Bibkey:
Cite (ACL):
Kang He, Yuzhe Ding, Rao Fu, Yukang Feng, Kaipeng Zhang, Yiming Liu, Fei Li, Chong Teng, and Donghong Ji. 2026. Uncertainty-Calibrated Elastic Alignment for Multimodal Sentiment Analysis with Missing Modalities. In Findings of the Association for Computational Linguistics: ACL 2026, pages 5268–5288, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Uncertainty-Calibrated Elastic Alignment for Multimodal Sentiment Analysis with Missing Modalities (He et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.260.pdf
Checklist:
 2026.findings-acl.260.checklist.pdf