PathBuilder: A Quality-Controlled LLM System for Personalized Learning Pathways

Jasper Meynard Arana, John Andrew Mañacop, John Allen Manacop, Roy Andrew Garcia, Keith Rick Piniera, Kristine Ann M. Carandang, Ethan Robert Casin, Christian Alis, Christopher Monterola


Abstract
Large language models (LLMs) enable scalable content generation for personalized learning, but reliability and pedagogical alignment remain open challenges. We present PathBuilder, a web-based system that integrates expert-validated assessment, retrieval-augmented generation (RAG), and an LLM-as-a-Judge validation loop within a closed instructional pipeline. The system uses a 17,758-item curriculum-aligned question bank, including 1,018 expert-approved LLM-generated items, to construct diagnostic and post-tests for fine-grained learner profiling. In a real-world deployment with 179 registered users (75 matched learners), PathBuilder achieved a mean absolute gain of 37.9 percentage points, Hake’s normalized gain of 0.760, and a large effect size (Cohen’s d = 0.98). A controlled study of the judge mechanism showed consistent high-quality instructional outputs with a 100% threshold pass rate. These results demonstrate that structured curriculum alignment combined with retrieval grounding and automated validation can support reliable LLM-based personalization in deployed learning systems. A live demonstration of PathBuilder is available at https://demo.pathbuilderedu.com.
Anthology ID:
2026.acl-demo.50
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Greg Durrett, Ping Jian
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
504–514
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-demo.50/
DOI:
Bibkey:
Cite (ACL):
Jasper Meynard Arana, John Andrew Mañacop, John Allen Manacop, Roy Andrew Garcia, Keith Rick Piniera, Kristine Ann M. Carandang, Ethan Robert Casin, Christian Alis, and Christopher Monterola. 2026. PathBuilder: A Quality-Controlled LLM System for Personalized Learning Pathways. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations), pages 504–514, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
PathBuilder: A Quality-Controlled LLM System for Personalized Learning Pathways (Arana et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-demo.50.pdf