DDGIP: Radiology Report Generation Through Disease Description Graph and Informed Prompting
Chentao Huang, Guangli Li, Xinjiong Zhou, Yafeng Ren, Hongbin Zhang
Abstract
Automatic radiology report generation has attracted considerable attention with the rise of computer-aided diagnostic systems. Due to the inherent biases in medical imaging data, generating reports with precise clinical details is challenging yet crucial for accurate diagnosis. To this end, we design a disease description graph that encapsulates comprehensive and pertinent disease information. By aligning visual features with the graph, our model enhances the quality of the generated reports. Furthermore, we introduce a novel informed prompting method which increases the accuracy of short-gram predictions, acting as an implicit bag-of-words planning for surface realization. Notably, this informed prompt succeeds with a three-layer decoder, reducing the reliance on conventional prompting methods that require extensive model parameters. Extensive experiments on two widely-used datasets, IU-Xray and MIMIC-CXR, demonstrate that our method outperforms previous state-of-the-art models.- Anthology ID:
- 2025.findings-naacl.215
- Volume:
- Findings of the Association for Computational Linguistics: NAACL 2025
- Month:
- April
- Year:
- 2025
- Address:
- Albuquerque, New Mexico
- Editors:
- Luis Chiruzzo, Alan Ritter, Lu Wang
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 3884–3894
- Language:
- URL:
- https://preview.aclanthology.org/Ingest-2025-COMPUTEL/2025.findings-naacl.215/
- DOI:
- Cite (ACL):
- Chentao Huang, Guangli Li, Xinjiong Zhou, Yafeng Ren, and Hongbin Zhang. 2025. DDGIP: Radiology Report Generation Through Disease Description Graph and Informed Prompting. In Findings of the Association for Computational Linguistics: NAACL 2025, pages 3884–3894, Albuquerque, New Mexico. Association for Computational Linguistics.
- Cite (Informal):
- DDGIP: Radiology Report Generation Through Disease Description Graph and Informed Prompting (Huang et al., Findings 2025)
- PDF:
- https://preview.aclanthology.org/Ingest-2025-COMPUTEL/2025.findings-naacl.215.pdf