Otter at MedExAct2026: Diverse Encoder Ensemble for Medical Decision Span Detection

Lalita Lowphansirikul, Piyalitt Ittichaiwong


Abstract
We build an ensemble of 10 transformer encoders for the MedExACT 2026 shared task on medical decision span detection. The ensemble is diversified along three training directions: encoder initialization (including domain-adaptive pre-training on clinical text), loss function, and data augmentation with LLM-generated synthetic notes and silver-labeled clinical documents. Greedy forward search selects the combination with the highest validation final score. A BERT-based boundary refiner is applied to the ensemble’s predicted spans to correct offset errors before submission.
Anthology ID:
2026.bionlp-2.7
Volume:
Proceedings of the BioNLP 2026 (Shared Tasks)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Deepak Gupta, Dina Demner-Fushman
Venues:
BioNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
47–53
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.7/
DOI:
Bibkey:
Cite (ACL):
Lalita Lowphansirikul and Piyalitt Ittichaiwong. 2026. Otter at MedExAct2026: Diverse Encoder Ensemble for Medical Decision Span Detection. In Proceedings of the BioNLP 2026 (Shared Tasks), pages 47–53, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Otter at MedExAct2026: Diverse Encoder Ensemble for Medical Decision Span Detection (Lowphansirikul & Ittichaiwong, BioNLP 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.7.pdf
Supplementarymaterial:
 2026.bionlp-2.7.SupplementaryMaterial.zip
Supplementarymaterial:
 2026.bionlp-2.7.SupplementaryMaterial.txt