Medical Text Simplification From Jargon Detection to Jargon-Aware Prompting

Taiki Papandreou, Jan Bakker, Jaap Kamps


Abstract
Jargon identification is critical for improving the accessibility of biomedical texts yet models are often evaluated on isolated datasets leaving open questions about generalization. After reproducing MedReadMes jargon detection results and extending evaluation to the PLABA dataset we find that transfer learning across datasets yields only modest gains largely due to divergent annotation objectives. Through manual re-annotation we show that aligning labeling schemes improves cross-dataset performance. Building on these findings we evaluate several jargon-aware prompting strategies for LLM-based medical text simplification. Explicitly highlighting jargon in prompts does not consistently improve simplification quality. When gains occur they often trade off against readability and are model-dependent. Human evaluation indicates that simple prompting can be as effective as more complex jargon-aware instructions. We release code to facilitate further research https//anonymous.4open.science/r/tsar-anonymous-2D66F/README.md
Anthology ID:
2025.tsar-1.3
Volume:
Proceedings of the Fourth Workshop on Text Simplification, Accessibility and Readability (TSAR 2025)
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Matthew Shardlow, Fernando Alva-Manchego, Kai North, Regina Stodden, Horacio Saggion, Nouran Khallaf, Akio Hayakawa
Venues:
TSAR | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
36–46
Language:
URL:
https://preview.aclanthology.org/ingest-emnlp/2025.tsar-1.3/
DOI:
Bibkey:
Cite (ACL):
Taiki Papandreou, Jan Bakker, and Jaap Kamps. 2025. Medical Text Simplification From Jargon Detection to Jargon-Aware Prompting. In Proceedings of the Fourth Workshop on Text Simplification, Accessibility and Readability (TSAR 2025), pages 36–46, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Medical Text Simplification From Jargon Detection to Jargon-Aware Prompting (Papandreou et al., TSAR 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-emnlp/2025.tsar-1.3.pdf