MathEDU: Feedback Generation on Problem-Solving Processes for Mathematical Learning Support

Wei-Ling Hsu, Yu-Chien Tang, An-Zi Yen


Abstract
The increasing reliance on Large Language Models (LLMs) across various domains extends to education, where students progressively use generative AI as a tool for learning. While prior work has examined LLMs’ mathematical ability, their reliability in grading authentic student problem-solving processes and delivering effective feedback remains underexplored. This study introduces MathEDU, a dataset consisting of student problem-solving processes in mathematics and corresponding teacher-written feedback. We systematically evaluate the reliability of various models across three hierarchical tasks: answer correctness classification, error identification, and feedback generation. Experimental results show that fine-tuning strategies effectively improve performance in classifying correctness and locating erroneous steps. However, the generated feedback across models shows a considerable gap from teacher-written feedback. Critically, the generated feedback is often verbose and fails to provide targeted explanations for the student’s underlying misconceptions. This emphasizes the urgent need for trustworthy and pedagogy-aware AI feedback in education.
Anthology ID:
2026.eacl-long.132
Volume:
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2883–2901
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.132/
DOI:
Bibkey:
Cite (ACL):
Wei-Ling Hsu, Yu-Chien Tang, and An-Zi Yen. 2026. MathEDU: Feedback Generation on Problem-Solving Processes for Mathematical Learning Support. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2883–2901, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
MathEDU: Feedback Generation on Problem-Solving Processes for Mathematical Learning Support (Hsu et al., EACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.132.pdf