A Calibrated and Interpretable Framework for Multilingual Text Difficulty Prediction
Voula Giouli, George Tsoulouhas, Athina Sioupi, Stamatia Michalopoulou
Abstract
Text difficulty prediction in educational contexts requires models that balance predictive performance, interpretability, calibration, and pedagogical alignment. While transformer-based approaches increasingly dominate text difficulty classification, educational applications demand transparent and linguistically grounded modeling. This paper presents work aimed at developing a workbench for CEFR-based text difficulty prediction. The proposed platform comprises three main components: (i) a tool for CEFR-aligned dataset preparation incorporating a pipeline for documenting, processing, and enriching textual data, (ii) CEFR-aligned datasets, and (iii) three alternative modeling approaches, namely a rule-based baseline, a feature-based Machine Learning (ML) classifier, and a fine-tuned BERT model. Our approach integrates linguistically informed feature engineering with data-driven modeling techniques, thereby balancing transparency and predictive performance. The proposed workbench has been designed as a language-agnostic infrastructure that can be extended to any language. In its current implementation, it has been applied to the creation of a German CEFR dataset, while its Greek counterpart is currently under development.- Anthology ID:
- 2026.determit-1.7
- Volume:
- Proceedings of the 2nd Workshop on Evaluating Text Difficulty in a Multilingual Context (DeTermIt! 2026)
- Month:
- May
- Year:
- 2026
- Address:
- Palma, Mallorca (Spain)
- Editors:
- Giorgio Maria Di Nunzio, Federica Vezzani, Liana Ermakova, Hosein Azarbonyad, Jaap Kamps
- Venues:
- DeTermIt | WS
- SIG:
- Publisher:
- ELRA Language Resources Association (ELRA)
- Note:
- Pages:
- 63–73
- Language:
- External URL:
- https://lrec.elra.info/lrec2026-ws-determit-07
- DOI:
- 10.63317/3cmykny29qkb
- Cite (ACL):
- Voula Giouli, George Tsoulouhas, Athina Sioupi, and Stamatia Michalopoulou. 2026. A Calibrated and Interpretable Framework for Multilingual Text Difficulty Prediction. In Proceedings of the 2nd Workshop on Evaluating Text Difficulty in a Multilingual Context (DeTermIt! 2026), pages 63–73, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
- Cite (Informal):
- A Calibrated and Interpretable Framework for Multilingual Text Difficulty Prediction (Giouli et al., DeTermIt 2026)