The MultiClinAI Shared Task on Multilingual Clinical Corpus Construction and Concept Extraction: Systems, Evaluation, and Datasets
Fernando Gallego Donoso, Salvador Lima-Lopez, Judith Rosell, Eulàlia Farré-Maduel, Martin Krallinger
Abstract
We present an overview of the MultiClinAI shared task, which focuses on multilingual clinical entity extraction and automatic corpus generation through annotation projection. It addresses two key challenges in clinical natural language processing (NLP): (i) developing comparable multilingual named entity recognition (NER) systems and (ii) automatically constructing multilingual clinical corpora through annotation projection. The MultiClinAI task provides a unified benchmark for evaluating multilingual and cross-lingual clinical NLP approaches that cover diseases, symptoms, and procedures in Spanish, English, Dutch, Italian, Romanian, Swedish, and Czech. A total of 21 teams from 13 countries participated, submitting 531 runs across the different subtasks. The top runs obtained very competitive results, close to human expert annotation quality. The results highlight both the challenges and opportunities of multilingual clinical information extraction. All resources, including a corpus of over 738,201 manually revised entity mentions across seven languages, are publicly available on Zenodo at: https://zenodo.org/records/19334278.- Anthology ID:
- 2026.smm4h-1.49
- Volume:
- Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, United States
- Editors:
- Guillermo Lopez-Garcia, Graciela Gonzalez-Hernandez
- Venues:
- SMM4H | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 309–331
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.smm4h-1.49/
- DOI:
- Cite (ACL):
- Fernando Gallego Donoso, Salvador Lima-Lopez, Judith Rosell, Eulàlia Farré-Maduel, and Martin Krallinger. 2026. The MultiClinAI Shared Task on Multilingual Clinical Corpus Construction and Concept Extraction: Systems, Evaluation, and Datasets. In Proceedings of the 11th Social Media Mining for Health Research and Applications (SMM4H-HeaRD 2026) Workshop and Shared Tasks, pages 309–331, San Diego, United States. Association for Computational Linguistics.
- Cite (Informal):
- The MultiClinAI Shared Task on Multilingual Clinical Corpus Construction and Concept Extraction: Systems, Evaluation, and Datasets (Donoso et al., SMM4H 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.smm4h-1.49.pdf