Structured Radiology Intelligence: Extracting Structured Data from MRI Reports Using LLMs
Sushvin Marimuthu, Parameswari Krishnamurthy, Dipti Misra Sharma, Goldwin H, Anu Eapen, Betty Simon, Anuradha Chandramohan
Abstract
This study presents efforts focused on extracting and structuring doctor notes, specifically Magnetic Resonance Imaging (MRI) reports, into a standardized format using large language models (LLMs). We introduce a novel benchmark dataset comprising of 55 clinically relevant variables given by doctors, making it the first of its kind in the automated processing of unstructured medical texts. The annotations to the dataset were generated using a systematic prompt-tuning approach that was manually validated. It was then evaluated across three experimental stages: baseline, intermediate, and fine-tuned. Each stage assessed the impact of different prompt strategies on the performance of various LLMs (LLaMA, Qwen, and DeepSeek). Among the models tested, LLaMA 3.1 8B Instruct consistently achieved the highest composite Score in both the intermediate and final phases, resulting in an 18.42% improvement in performance.- Anthology ID:
- 2026.cl4health-1.24
- Volume:
- Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026
- Month:
- May
- Year:
- 2026
- Address:
- Palma, Mallorca (Spain)
- Editors:
- Deepak Gupta, Paul Thompson, Sophia Ananiadou, Dina Demner-Fushman
- Venues:
- CL4Health | WS
- SIG:
- Publisher:
- ELRA Language Resources Association (ELRA)
- Note:
- Pages:
- 268–280
- Language:
- External URL:
- https://lrec.elra.info/lrec2026-ws-cl4health-24
- DOI:
- 10.63317/4vob5zztrfso
- Cite (ACL):
- Sushvin Marimuthu, Parameswari Krishnamurthy, Dipti Misra Sharma, Goldwin H, Anu Eapen, Betty Simon, and Anuradha Chandramohan. 2026. Structured Radiology Intelligence: Extracting Structured Data from MRI Reports Using LLMs. In Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026, pages 268–280, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
- Cite (Informal):
- Structured Radiology Intelligence: Extracting Structured Data from MRI Reports Using LLMs (Marimuthu et al., CL4Health 2026)