BiCAL: Bi-directional Contrastive Active Learning for Clinical Report Generation

Tianyi Wu, Jingqing Zhang, Wenjia Bai, Kai Sun

Abstract
State-of-the-art performance by large pre-trained models in computer vision (CV) and natural language processing (NLP) suggests their potential for domain-specific tasks. However, training these models requires vast amounts of labelled data, a challenge in many domains due to the cost and expertise required for data labelling. Active Learning (AL) can mitigate this by selecting minimal yet informative data for model training. While AL has been mainly applied to single-modal tasks in the fields of NLP and CV, its application in multi-modal tasks remains underexplored. In this work, we proposed a novel AL strategy, Bidirectional Contrastive Active Learning strategy (BiCAL), that used both image and text latent spaces to identify contrastive samples to select batches to query for labels. BiCAL was robust to class imbalance data problems by its design, which is a problem that is commonly seen in training domain-specific models. We assessed BiCAL’s performance in domain-specific learning on the clinical report generation tasks from chest X-ray images. Our experiments showed that BiCAL outperforms State-of-the-art methods in clinical efficacy metrics, improving recall by 2.4% and F1 score by 9.5%, showcasing its effectiveness in actively training domain-specific multi-modal models.
Anthology ID:
2024.bionlp-1.25
Volume:
Proceedings of the 23rd Workshop on Biomedical Natural Language Processing
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Dina Demner-Fushman, Sophia Ananiadou, Makoto Miwa, Kirk Roberts, Junichi Tsujii
Venues:
BioNLP | WS
SIG:
SIGBIOMED
Publisher:
Association for Computational Linguistics
Note:
Pages:
328–341
Language:
URL:
https://aclanthology.org/2024.bionlp-1.25
DOI:
10.18653/v1/2024.bionlp-1.25
Bibkey:
Cite (ACL):
Tianyi Wu, Jingqing Zhang, Wenjia Bai, and Kai Sun. 2024. BiCAL: Bi-directional Contrastive Active Learning for Clinical Report Generation. In Proceedings of the 23rd Workshop on Biomedical Natural Language Processing, pages 328–341, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
BiCAL: Bi-directional Contrastive Active Learning for Clinical Report Generation (Wu et al., BioNLP-WS 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-5/2024.bionlp-1.25.pdf
PDF Search