Evaluating Direct Preference Optimization for Personalizing German Automatic Text Simplifications for Persons with Intellectual Disabilities
Yingqiang Gao, Kaede Johnson, David Fröhlich, Luisa Carrer, Sarah Ebling
Abstract
Automatic text simplification (ATS) aims to enhance language accessibility for various target groups, particularly persons with intellectual disabilities. Recent advancements in large language models (LLMs) have substantially improved the quality of machine-generated text simplifications, however, existing LLM-based ATS systems do not incorporate preference feedback during post-training, resulting in a lack of personalization tailored to the specific needs of target group persons. In this work, we propose an ATS personalization framework using direct preference optimization (DPO). Specifically, we post-trained LLM-based ATS models using human feedback collected from persons with intellectual disabilities, reflecting their preferences of paired text simplifications generated by mainstream LLMs. Our pipeline for developing personalized LLM-based ATS systems encompasses data collection, model selection, supervised fine-tuning (SFT) and DPO post-training, and result evaluation. Our findings underscore the necessity of active participation of target group persons in designing personalized inclusive AI solutions aligned with human preferences.- Anthology ID:
- 2026.ltedi-1.5
- Volume:
- Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion
- Month:
- July
- Year:
- 2026
- Address:
- Virtual (Online)
- Editors:
- Bharathi Raja Chakravarthi, Bharathi B, Paul Buitelaar, Durairaj Thenmozhi, Miguel Ángel García Cumbreras, Salud María Jiménez Zafra
- Venues:
- LTEDI | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 43–62
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.ltedi-1.5/
- DOI:
- Cite (ACL):
- Yingqiang Gao, Kaede Johnson, David Fröhlich, Luisa Carrer, and Sarah Ebling. 2026. Evaluating Direct Preference Optimization for Personalizing German Automatic Text Simplifications for Persons with Intellectual Disabilities. In Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion, pages 43–62, Virtual (Online). Association for Computational Linguistics.
- Cite (Informal):
- Evaluating Direct Preference Optimization for Personalizing German Automatic Text Simplifications for Persons with Intellectual Disabilities (Gao et al., LTEDI 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.ltedi-1.5.pdf