CCD: Mitigating Hallucinations in Radiology MLLMs via Clinical Contrastive Decoding

Xi Zhang, Zaiqiao Meng, Jake Lever, Edmond S. L. Ho


Abstract
Multimodal large language models (MLLMs) have recently achieved remarkable progress in radiology by integrating visual perception with natural language understanding. However, they often generate clinically unsupported descriptions, known as medical hallucinations, which pose serious risks in medical applications that demand accuracy and image-grounded outputs. Through empirical analysis, we find that prompt-induced hallucinations remain prevalent in radiology MLLMs, largely due to over-sensitivity to clinical sections. To address this, we introduce **C**linical **C**ontrastive **D**ecoding (**CCD**), a ***training-free*** and ***retrieval-free*** inference framework that integrates structured clinical signals from task-specific radiology expert models. CCD introduces a dual-stage contrastive mechanism to refine token-level logits during generation, thereby enhancing clinical fidelity without modifying the base MLLM. Experiments on three datasets and multiple models demonstrate that CCD consistently improves overall performance on radiology report generation (RRG). On the MIMIC-CXR dataset, it yields up to a 17% improvement in RadGraph-F1 when applied to state-of-the-art RRG models. Our approach provides a lightweight and generalisable solution for mitigating medical hallucinations, effectively bridging expert models and MLLMs in radiology.
Anthology ID:
2026.findings-acl.1755
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
35174–35200
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1755/
DOI:
Bibkey:
Cite (ACL):
Xi Zhang, Zaiqiao Meng, Jake Lever, and Edmond S. L. Ho. 2026. CCD: Mitigating Hallucinations in Radiology MLLMs via Clinical Contrastive Decoding. In Findings of the Association for Computational Linguistics: ACL 2026, pages 35174–35200, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
CCD: Mitigating Hallucinations in Radiology MLLMs via Clinical Contrastive Decoding (Zhang et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1755.pdf
Checklist:
 2026.findings-acl.1755.checklist.pdf