Boosting Radiology Report Generation by Infusing Comparison Prior
Sanghwan Kim, Farhad Nooralahzadeh, Morteza Rohanian, Koji Fujimoto, Mizuho Nishio, Ryo Sakamoto, Fabio Rinaldi, Michael Krauthammer
Abstract
Recent transformer-based models have made significant strides in generating radiology reports from chest X-ray images. However, a prominent challenge remains; these models often lack prior knowledge, resulting in the generation of synthetic reports that mistakenly reference non-existent prior exams. This discrepancy can be attributed to a knowledge gap between radiologists and the generation models. While radiologists possess patient-specific prior information, the models solely receive X-ray images at a specific time point. To tackle this issue, we propose a novel approach that leverages a rule-based labeler to extract comparison prior information from radiology reports. This extracted comparison prior is then seamlessly integrated into state-of-the-art transformer-based models, enabling them to produce more realistic and comprehensive reports. Our method is evaluated on English report datasets, such as IU X-ray and MIMIC-CXR. The results demonstrate that our approach surpasses baseline models in terms of natural language generation metrics. Notably, our model generates reports that are free from false references to non-existent prior exams, setting it apart from previous models. By addressing this limitation, our approach represents a significant step towards bridging the gap between radiologists and generation models in the domain of medical report generation.- Anthology ID:
- 2023.bionlp-1.4
- Volume:
- The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Dina Demner-fushman, Sophia Ananiadou, Kevin Cohen
- Venue:
- BioNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 50–61
- Language:
- URL:
- https://aclanthology.org/2023.bionlp-1.4
- DOI:
- 10.18653/v1/2023.bionlp-1.4
- Cite (ACL):
- Sanghwan Kim, Farhad Nooralahzadeh, Morteza Rohanian, Koji Fujimoto, Mizuho Nishio, Ryo Sakamoto, Fabio Rinaldi, and Michael Krauthammer. 2023. Boosting Radiology Report Generation by Infusing Comparison Prior. In The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks, pages 50–61, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- Boosting Radiology Report Generation by Infusing Comparison Prior (Kim et al., BioNLP 2023)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-2/2023.bionlp-1.4.pdf