How to use Language Models for Synthetic Text Generation in Cerebrovascular Disease-specific Medical Reports

Byoung-Doo Oh, Gi-Youn Kim, Chulho Kim, Yu-Seop Kim


Abstract
The quantity and quality of data have a significant impact on the performance of artificial intelligence (AI). However, in the biomedical domain, data often contains sensitive information such as personal details, making it challenging to secure enough data for medical AI. Consequently, there is a growing interest in synthetic data generation for medical AI. However, research has primarily focused on medical images, with little given to text-based data such as medical records. Therefore, this study explores the application of language models (LMs) for synthetic text generation in low-resource domains like medical records. It compares the results of synthetic text generation based on different LMs. To achieve this, we focused on two criteria for LM-based synthetic text generation of medical records using two keywords entered by the user: 1) the impact of the LM’s knowledge, 2) the impact of the LM’s size. Additionally, we objectively evaluated the generated synthetic text, including representative metrics such as BLUE and ROUGE, along with clinician’s evaluations.
Anthology ID:
2024.personalize-1.2
Volume:
Proceedings of the 1st Workshop on Personalization of Generative AI Systems (PERSONALIZE 2024)
Month:
March
Year:
2024
Address:
St. Julians, Malta
Editors:
Ameet Deshpande, EunJeong Hwang, Vishvak Murahari, Joon Sung Park, Diyi Yang, Ashish Sabharwal, Karthik Narasimhan, Ashwin Kalyan
Venues:
PERSONALIZE | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
10–17
Language:
URL:
https://aclanthology.org/2024.personalize-1.2
DOI:
Bibkey:
Cite (ACL):
Byoung-Doo Oh, Gi-Youn Kim, Chulho Kim, and Yu-Seop Kim. 2024. How to use Language Models for Synthetic Text Generation in Cerebrovascular Disease-specific Medical Reports. In Proceedings of the 1st Workshop on Personalization of Generative AI Systems (PERSONALIZE 2024), pages 10–17, St. Julians, Malta. Association for Computational Linguistics.
Cite (Informal):
How to use Language Models for Synthetic Text Generation in Cerebrovascular Disease-specific Medical Reports (Oh et al., PERSONALIZE-WS 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2024.personalize-1.2.pdf