Evaluation of Multilingual Text Simplification for the Mental Health Domain: Exploring Small Language Models

Olga Pelloni, Sandra Just, Lars Bongo


Abstract
Individuals with particular mental health disorders may find it difficult to learn about their own condition. Therefore, efforts have been made to create materials that explain complex medical information in simpler words, which are also beneficial for caregivers and others. However, text simplification is commonly done in English and only sporadically in other languages. In this study, we explore potential ways for language-agnostic medical text simplification for the mental health domain. Our approach is to simplify the ICD-11 articles on primary psychotic disorders in English, German and French, using small LMs and various metrics for evaluating different aspects of the texts: lexical complexity and readability. Our results show that acceptable texts were produced only in English, and that a joint analysis of Measure of Textual Lexical Diversity (MTLD) and Flesch Reading Ease (FRE) provides the most insight, capturing both the best outcomes and signaling different types of issue. The study is preliminary and requires further investigation.
Anthology ID:
2026.bionlp-1.36
Volume:
BioNLP 2026
Month:
July
Year:
2026
Address:
San Diego, California
Editors:
Dina Demner-Fushman, Sophia Ananiadou, Kirk Roberts, Junichi Tsujii
Venues:
BioNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
464–474
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-1.36/
DOI:
Bibkey:
Cite (ACL):
Olga Pelloni, Sandra Just, and Lars Bongo. 2026. Evaluation of Multilingual Text Simplification for the Mental Health Domain: Exploring Small Language Models. In BioNLP 2026, pages 464–474, San Diego, California. Association for Computational Linguistics.
Cite (Informal):
Evaluation of Multilingual Text Simplification for the Mental Health Domain: Exploring Small Language Models (Pelloni et al., BioNLP 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-1.36.pdf