Abstract
Neural models for text generation are often designed in an end-to-end fashion, typically with zero control over intermediate computations, limiting their practical usability in downstream applications. In this work, we incorporate explicit means into neural models to ensure topical continuity, informativeness and content diversity of generated radiology reports. For the purpose we propose a method to compute image representations specific to each sentential context and eliminate redundant content by exploiting diverse sentence states. We conduct experiments to generate radiology reports from medical images of chest x-rays using MIMIC-CXR. Our model outperforms baselines by up to 18% and 29% respective in the evaluation for informativeness and content ordering respectively, relative on objective metrics and 16% on human evaluation.- Anthology ID:
- 2021.naacl-industry.31
- Volume:
- Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Industry Papers
- Month:
- June
- Year:
- 2021
- Address:
- Online
- Editors:
- Young-bum Kim, Yunyao Li, Owen Rambow
- Venue:
- NAACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 246–254
- Language:
- URL:
- https://aclanthology.org/2021.naacl-industry.31
- DOI:
- 10.18653/v1/2021.naacl-industry.31
- Cite (ACL):
- Litton J Kurisinkel, Ai Ti Aw, and Nancy F Chen. 2021. Coherent and Concise Radiology Report Generation via Context Specific Image Representations and Orthogonal Sentence States. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Industry Papers, pages 246–254, Online. Association for Computational Linguistics.
- Cite (Informal):
- Coherent and Concise Radiology Report Generation via Context Specific Image Representations and Orthogonal Sentence States (J Kurisinkel et al., NAACL 2021)
- PDF:
- https://preview.aclanthology.org/add_acl24_videos/2021.naacl-industry.31.pdf