Multi-step Large Language Model for Fine-Grained Feedback in Stepwise Linear Equation Solutions

Imran Chamieh, Torsten Zesch, Klaus Giebermann


Abstract
This paper addresses the problem of fine-grained error classification in stepwise algebraic problem solving, with the objective of enabling accurate and timely feedback in large-scale educational environments. Using authentic student response data, we compare a carefully engineered rule-based baseline with large language models (LLMs) in zero-shot and few-shot configurations, as well as multistep LLM-based approaches. We further consider hybrid architectures that combine symbolic computation with LLM inferential processes, with particular emphasis on enhancing the robustness and faithfulness of intermediate representations and mitigating error propagation across successive stages of the computational pipeline. Our empirical results indicate that, although the baseline model delivers strong and reliable performance for narrowly defined error categories, structured multi-step approaches improve performance relative to single-step methods by achieving superior precision, F1 scores, and overall accuracy.
Anthology ID:
2026.bea-1.28
Volume:
Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Bashar Alhafni, Stefano Bannò, Marie Bexte, Jill Burstein, Andrea Horbach, Ronja Laarmann-Quante, Anais Tack, Victoria Yaneva, Zheng Yuan
Venues:
BEA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
419–431
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bea-1.28/
DOI:
Bibkey:
Cite (ACL):
Imran Chamieh, Torsten Zesch, and Klaus Giebermann. 2026. Multi-step Large Language Model for Fine-Grained Feedback in Stepwise Linear Equation Solutions. In Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026), pages 419–431, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Multi-step Large Language Model for Fine-Grained Feedback in Stepwise Linear Equation Solutions (Chamieh et al., BEA 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bea-1.28.pdf