Zero-Shot, Fine-Tuned, and Retrieval-Augmented Extraction of Clinical Decisions with Corpus Boundary Diagnostics

Mohammed Alliheedi, Robert Mercer, Anemily Machina, Sudipta Roy, Yetian Wang, Xindi Wang


Abstract
We present the CanSA system for the MedEx-ACT@ACL 2026 shared task, which requires extracting and classifying clinical decisions from ICU discharge summaries into nine DIC-TUM categories. We have developed three approaches: (1) a training-free system which consists of a preprocessing module that normalizes text and an inference engine combining zero shot LLMs with a RAG ensemble, (2) a supervised fine-tuning method which required training, and (3) a training-free retrieval-augmented pipeline employing TF–IDF-based lexical retrieval to surface in-context exemplars from the development corpus, combined with section aware chunking and structured extraction calls to a large language model. Our team’s best submission achieved a Final Score of 0.41, ranking 34th out of 37 on the official test leaderboard.
Anthology ID:
2026.bionlp-2.20
Volume:
Proceedings of the BioNLP 2026 (Shared Tasks)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Deepak Gupta, Dina Demner-Fushman
Venues:
BioNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
141–145
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.20/
DOI:
Bibkey:
Cite (ACL):
Mohammed Alliheedi, Robert Mercer, Anemily Machina, Sudipta Roy, Yetian Wang, and Xindi Wang. 2026. Zero-Shot, Fine-Tuned, and Retrieval-Augmented Extraction of Clinical Decisions with Corpus Boundary Diagnostics. In Proceedings of the BioNLP 2026 (Shared Tasks), pages 141–145, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Zero-Shot, Fine-Tuned, and Retrieval-Augmented Extraction of Clinical Decisions with Corpus Boundary Diagnostics (Alliheedi et al., BioNLP 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.20.pdf
Supplementarymaterial:
 2026.bionlp-2.20.SupplementaryMaterial.zip
Supplementarymaterial:
 2026.bionlp-2.20.SupplementaryMaterial.txt