CAIR: Causal Adaptive Information-based Reinforcement Learning for Multimodal Emotion Reasoning

Fengyu Zhang, Bin Liu, Jianhua Tao, Zhuofan Wen, Shun Chen, Hailiang Yao, Zhengqi Wen


Abstract
Multimodal emotion reasoning requires both accurate identification and logical rationales to explain emotional triggers. However, current methods often suffer from causal degeneracy, where models produce linguistically fluent but superficial explanations that lack authentic logical derivation. To resolve this, we propose CAIR (Causal Adaptive Information-based Reinforcement Learning), a reinforcement learning framework that treats rationales as causal mediators between raw perceptual signals and emotional semantics. Our core contribution is the Causal Mediation Reward (CMR), which quantifies a rationale’s interventional utility by measuring its marginal contribution to resolving predictive uncertainty. Additionally, we introduce an adaptive optimization mechanism based on the information bottleneck to balance perception and reasoning across varying cognitive loads. CAIR achieves state-of-the-art performance on MTMEUR with 73.80% accuracy and competitive results on the SCEA subset of EmoBench-M (68.5%), outperforming specialized SFT baselines by up to 14.4% while enhancing rationale faithfulness. Our findings underscore that principled reward design, rather than mere model scaling, is essential for building systems with authentic, human-like emotional understanding.
Anthology ID:
2026.findings-acl.1263
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
25249–25264
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1263/
DOI:
Bibkey:
Cite (ACL):
Fengyu Zhang, Bin Liu, Jianhua Tao, Zhuofan Wen, Shun Chen, Hailiang Yao, and Zhengqi Wen. 2026. CAIR: Causal Adaptive Information-based Reinforcement Learning for Multimodal Emotion Reasoning. In Findings of the Association for Computational Linguistics: ACL 2026, pages 25249–25264, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
CAIR: Causal Adaptive Information-based Reinforcement Learning for Multimodal Emotion Reasoning (Zhang et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1263.pdf
Checklist:
 2026.findings-acl.1263.checklist.pdf