LAMAR at MedExACT 2026: Agreement-Driven Large Language Model Ensembles for Clinical Decision Extraction from Discharge Summaries

Monrada Chiewhawan, Keetawan Limaroon, Titipat Achakulvisut


Abstract
This paper presents an ensemble of Qwen3.5-4B language models for extracting medical decisions from discharge summaries in the MedDec dataset. The models were trained to annotate discharge summaries with inline XML-like tags. Three different training strategies were used including dynamic fine-tuning, reinforcement learning, and pseudo-label augmentation. By combining predictions based on inter-model agreement, the system improved performance across evaluation metrics, achieving an overall F1 of 0.5942 and ranking second on the test leaderboard. The results also showed stable performance across demographic groups, suggesting fairness for underrepresented populations.
Anthology ID:
2026.bionlp-2.25
Volume:
Proceedings of the BioNLP 2026 (Shared Tasks)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Deepak Gupta, Dina Demner-Fushman
Venues:
BioNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
179–190
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.25/
DOI:
Bibkey:
Cite (ACL):
Monrada Chiewhawan, Keetawan Limaroon, and Titipat Achakulvisut. 2026. LAMAR at MedExACT 2026: Agreement-Driven Large Language Model Ensembles for Clinical Decision Extraction from Discharge Summaries. In Proceedings of the BioNLP 2026 (Shared Tasks), pages 179–190, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
LAMAR at MedExACT 2026: Agreement-Driven Large Language Model Ensembles for Clinical Decision Extraction from Discharge Summaries (Chiewhawan et al., BioNLP 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.25.pdf
Supplementarymaterial:
 2026.bionlp-2.25.SupplementaryMaterial.txt
Supplementarymaterial:
 2026.bionlp-2.25.SupplementaryMaterial.zip