Overview of the MEDIQA-OE 2025 Shared Task on Medical Order Extraction from Doctor-Patient Consultations
Jean-Philippe Corbeil, Asma Ben Abacha, Jerome Tremblay, Phillip Swazinna, Akila Jeeson Daniel, Miguel Del-Agua, Francois Beaulieu
Abstract
Clinical documentation increasingly uses automatic speech recognition and summarization, yet converting conversations into actionable medical orders for Electronic Health Records remains unexplored. A solution to this problem can significantly reduce the documentation burden of clinicians and directly impact downstream patient care. We introduce the MEDIQA-OE 2025 shared task, the first challenge on extracting medical orders from doctor-patient conversations. Six teams participated in the shared task and experimented with a broad range of approaches, and both closed- and open-weight large language models (LLMs). In this paper, we describe the MEDIQA-OE task, dataset, final leaderboard ranking, and participants’ solutions.- Anthology ID:
- 2025.clinicalnlp-1.2
- Volume:
- Proceedings of the 7th Clinical Natural Language Processing Workshop
- Month:
- October
- Year:
- 2025
- Address:
- Virtual
- Editors:
- Asma Ben Abacha, Steven Bethard, Danielle Bitterman, Tristan Naumann, Kirk Roberts
- Venues:
- ClinicalNLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 11–16
- Language:
- URL:
- https://preview.aclanthology.org/retractions/2025.clinicalnlp-1.2/
- DOI:
- Cite (ACL):
- Jean-Philippe Corbeil, Asma Ben Abacha, Jerome Tremblay, Phillip Swazinna, Akila Jeeson Daniel, Miguel Del-Agua, and Francois Beaulieu. 2025. Overview of the MEDIQA-OE 2025 Shared Task on Medical Order Extraction from Doctor-Patient Consultations. In Proceedings of the 7th Clinical Natural Language Processing Workshop, pages 11–16, Virtual. Association for Computational Linguistics.
- Cite (Informal):
- Overview of the MEDIQA-OE 2025 Shared Task on Medical Order Extraction from Doctor-Patient Consultations (Corbeil et al., ClinicalNLP 2025)
- PDF:
- https://preview.aclanthology.org/retractions/2025.clinicalnlp-1.2.pdf