Classification of Student Struggle in Mathematics

Hannah Levin, Madhura Padwal, Nchimunya Mwiinga


Abstract
Productive struggle is a critical component of mathematics education, requiring students to actively work through ideas rather than just making errors. However, identifying this struggle from text transcripts is challenging because students often mask confusion with epistemic hedging rather than direct statements. Zero-shot large language models exhibit a conservative bias, systematically under-detecting struggle in classroom discourse. We introduce a two-stage NLP pipeline comprising a lexical heuristic gate and an LLM subtype classifier. Our model achieves 90.0% binary accuracy and 84.0% 4-category accuracy. We demonstrate the pedagogical value of this tool by showing that struggle is uniquely concentrated during explicit mathematical reasoning, offering educators a scalable method for root-cause analysis.
Anthology ID:
2026.bea-1.36
Volume:
Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Bashar Alhafni, Stefano Bannò, Marie Bexte, Jill Burstein, Andrea Horbach, Ronja Laarmann-Quante, Anais Tack, Victoria Yaneva, Zheng Yuan
Venues:
BEA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
513–528
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bea-1.36/
DOI:
Bibkey:
Cite (ACL):
Hannah Levin, Madhura Padwal, and Nchimunya Mwiinga. 2026. Classification of Student Struggle in Mathematics. In Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026), pages 513–528, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Classification of Student Struggle in Mathematics (Levin et al., BEA 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bea-1.36.pdf