Knowledge Enhanced Deep Learning Model for Radiology Text Generation
Kaveri Kale, Pushpak Bhattacharya, Aditya Shetty, Milind Gune, Kush Shrivastava, Rustom Lawyer, Spriha Biswas
Abstract
Manual radiology report generation is a time-consuming task. First, radiologists prepare brief notes while carefully examining the imaging report. Then, radiologists or their secretaries create a full-text report that describes the findings by referring to the notes. Automatic radiology report generation is the primary objective of this research. The central part of automatic radiology report generation is generating the finding section (main body of the report) from the radiologists’ notes. In this research, we suggest a knowledge graph (KG) enhanced radiology text generator that can provide additional domain-specific information. Our approach uses a KG-BART model to generate a description of clinical findings (referred to as pathological description) from radiologists’ brief notes. We have constructed a parallel dataset of radiologists’ notes and corresponding pathological descriptions to train the KG-BART model. Our findings demonstrate that, compared to the BART-large and T5-large models, the BLEU-2 score of the pathological descriptions generated by our approach is raised by 4% and 9%, and the ROUGE-L score by 2% and 2%, respectively. Our analysis shows that the KG-BART model for radiology text generation outperforms the T5-large model. Furthermore, we apply our proposed radiology text generator for whole radiology report generation.- Anthology ID:
- 2022.icon-main.4
- Volume:
- Proceedings of the 19th International Conference on Natural Language Processing (ICON)
- Month:
- December
- Year:
- 2022
- Address:
- New Delhi, India
- Editors:
- Md. Shad Akhtar, Tanmoy Chakraborty
- Venue:
- ICON
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 32–42
- Language:
- URL:
- https://aclanthology.org/2022.icon-main.4
- DOI:
- Cite (ACL):
- Kaveri Kale, Pushpak Bhattacharya, Aditya Shetty, Milind Gune, Kush Shrivastava, Rustom Lawyer, and Spriha Biswas. 2022. Knowledge Enhanced Deep Learning Model for Radiology Text Generation. In Proceedings of the 19th International Conference on Natural Language Processing (ICON), pages 32–42, New Delhi, India. Association for Computational Linguistics.
- Cite (Informal):
- Knowledge Enhanced Deep Learning Model for Radiology Text Generation (Kale et al., ICON 2022)
- PDF:
- https://preview.aclanthology.org/revert-3132-ingestion-checklist/2022.icon-main.4.pdf