Zero-Shot, Fine-Tuned, and Retrieval-Augmented Extraction of Clinical Decisions with Corpus Boundary Diagnostics
Mohammed Alliheedi, Robert Mercer, Anemily Machina, Sudipta Roy, Yetian Wang, Xindi Wang
Abstract
We present the CanSA system for the MedEx-ACT@ACL 2026 shared task, which requires extracting and classifying clinical decisions from ICU discharge summaries into nine DIC-TUM categories. We have developed three approaches: (1) a training-free system which consists of a preprocessing module that normalizes text and an inference engine combining zero shot LLMs with a RAG ensemble, (2) a supervised fine-tuning method which required training, and (3) a training-free retrieval-augmented pipeline employing TF–IDF-based lexical retrieval to surface in-context exemplars from the development corpus, combined with section aware chunking and structured extraction calls to a large language model. Our team’s best submission achieved a Final Score of 0.41, ranking 34th out of 37 on the official test leaderboard.- Anthology ID:
- 2026.bionlp-2.20
- Volume:
- Proceedings of the BioNLP 2026 (Shared Tasks)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Deepak Gupta, Dina Demner-Fushman
- Venues:
- BioNLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 141–145
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.20/
- DOI:
- Cite (ACL):
- Mohammed Alliheedi, Robert Mercer, Anemily Machina, Sudipta Roy, Yetian Wang, and Xindi Wang. 2026. Zero-Shot, Fine-Tuned, and Retrieval-Augmented Extraction of Clinical Decisions with Corpus Boundary Diagnostics. In Proceedings of the BioNLP 2026 (Shared Tasks), pages 141–145, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- Zero-Shot, Fine-Tuned, and Retrieval-Augmented Extraction of Clinical Decisions with Corpus Boundary Diagnostics (Alliheedi et al., BioNLP 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.20.pdf