Edith Graf
2025
Mathematical Computation and Reasoning Errors by Large Language Models
Liang Zhang | Edith Graf
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Liang Zhang | Edith Graf
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
We evaluate four LLMs (GPT-4o, o1, DeepSeek-V3, DeepSeek-R1) on purposely challenging arithmetic, algebra, and number-theory items. Coding final answers and step-level solutions correctness reveals performance gaps, improvement paths, and how accurate LLMs can strengthen mathematics assessment and instruction.