Credal Concept Bottleneck Models for Epistemic–Aleatoric Uncertainty Decomposition
Tanmoy Mukherjee, Thomas Bailleux, Pierre Marquis, Zied Bouraoui
Abstract
Concept Bottleneck Models (CBMs) predict through human-interpretable concepts, but they typically output point concept probabilities that conflate epistemic uncertainty (reducible model underspecification) with aleatoric uncertainty (irreducible input ambiguity). This makes concept-level uncertainty hard to interpret and, more importantly, hard to act upon. We introduce (Credal Ensemble Concept Estimation), a CBM framework that decomposes concept uncertainty by construction. represents each concept as a credal prediction (a probability interval), derives epistemic uncertainty from disagreement across diverse concept heads, and estimates aleatoric uncertainty via a dedicated ambiguity output trained to match annotator disagreement when available. The resulting signals support prescriptive decisions: automate low-uncertainty cases, prioritize data collection for high-epistemic cases, route high-aleatoric cases to human review, and abstain when both are high. Across several tasks, we show that epistemic uncertainty is positively associated with prediction errors, whereas aleatoric uncertainty closely tracks annotator disagreement, providing guidance beyond error correlation. Our implementation is available at the following link: https://github.com/Tankiit/Credal_Sets/tree/ensemble-credal-cbm- Anthology ID:
- 2026.acl-long.1991
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 42961–42980
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.1991/
- DOI:
- Cite (ACL):
- Tanmoy Mukherjee, Thomas Bailleux, Pierre Marquis, and Zied Bouraoui. 2026. Credal Concept Bottleneck Models for Epistemic–Aleatoric Uncertainty Decomposition. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 42961–42980, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- Credal Concept Bottleneck Models for Epistemic–Aleatoric Uncertainty Decomposition (Mukherjee et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.1991.pdf