Criterial Features in German: Towards Interpretable NLP in Readability Assessment

Denise Loefflad, Sofia Kathmann, Heiko Holz, Detmar Meurers


Abstract
This paper presents an empirical evaluation of the German Grammar Profile (GGP), a CEFR-aligned resource of criterial features, and its corresponding extraction system PALME. We design a systematic test suite in which each feature extractor is evaluated on controlled positive and negative examples. The results show that PALME achieves high precision and recall across all CEFR levels, with over 90% of features achieving scores above 0.8. Qualitative analysis shows that lower performance primarily results from morphological ambiguity in noun and adjective case marking. To evaluate the usefulness of the criterial features of the GGP for CEFR-aligned readability assessment, we assess their predictive power using Explainable Boosting Machines on graded readers. The model achieves strong performance (precision: 0.75, recall: 0.73). Our qualitative analysis shows that features related to specific verb constructions follow patterns consistent with developmental stages predicted by Processability Theory. These findings underline the value and relevance of criterial features for modeling language development in readability assessment.
Anthology ID:
2026.bea-1.6
Volume:
Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Bashar Alhafni, Stefano Bannò, Marie Bexte, Jill Burstein, Andrea Horbach, Ronja Laarmann-Quante, Anais Tack, Victoria Yaneva, Zheng Yuan
Venues:
BEA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
63–77
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bea-1.6/
DOI:
Bibkey:
Cite (ACL):
Denise Loefflad, Sofia Kathmann, Heiko Holz, and Detmar Meurers. 2026. Criterial Features in German: Towards Interpretable NLP in Readability Assessment. In Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026), pages 63–77, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Criterial Features in German: Towards Interpretable NLP in Readability Assessment (Loefflad et al., BEA 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bea-1.6.pdf