Evaluating Adaptive Personalization of Educational Readings with Simulated Learners

Ryan Woo, Anmol Rao, Aryan Keluskar, Yinong Chen


Abstract
We present a framework for evaluating adaptive personalization of educational reading materials with theory-grounded simulated learners. Unlike typical intelligent tutoring systems that adapt questions or feedback, we treat reading as the primary intervention and use question answering only as an observation channel for Bayesian Knowledge Tracing (BKT). This enables controlled comparison of LLM-powered adaptive and non-adaptive reading policies before classroom deployment.The framework links open educational content to a shared ontology of learning objectives and knowledge components, which is used to generate aligned reading–assessment pairs targeting one objective at a time. Simulated learners update their knowledge through a comprehension-and-memory process that models encoding, integration with prior knowledge, and misconception revision.The learner model combines established theories of reading with constrained answer selection, ensuring responses are generated only from information the learner has plausibly retained. Together, these components provide an interpretable offline testbed for studying whether adaptive reading improves learning outcomes.
Anthology ID:
2026.bea-1.63
Volume:
Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Bashar Alhafni, Stefano Bannò, Marie Bexte, Jill Burstein, Andrea Horbach, Ronja Laarmann-Quante, Anais Tack, Victoria Yaneva, Zheng Yuan
Venues:
BEA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
941–950
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bea-1.63/
DOI:
Bibkey:
Cite (ACL):
Ryan Woo, Anmol Rao, Aryan Keluskar, and Yinong Chen. 2026. Evaluating Adaptive Personalization of Educational Readings with Simulated Learners. In Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026), pages 941–950, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Evaluating Adaptive Personalization of Educational Readings with Simulated Learners (Woo et al., BEA 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bea-1.63.pdf