Math-DB: A Discourse Framework for Mathematical Word Problems to Enhance LLM Reasoning

Mustafa Erolcan Er


Abstract
Large Language Models have demonstrated significant progress in solving mathematical word problems through techniques like Chain-of-Thought (CoT) prompting. However, recent research indicates that these models often rely on statistical regularities and surface-level patterns rather than true logical reasoning, leading to performance drops when faced with minor problem perturbations or irrelevant information. In this study, we introduce Math Discourse Bank (Math-DB), a novel discourse framework and annotated dataset designed to enhance LLM reasoning. Inspired by the Penn Discourse TreeBank (PDTB) and mathematics education research, Math-DB defines a hierarchy of discourse senses designed for quantitative reasoning, including categories such as Change, Combine, Compare, and Equalize. We applied this framework to the GSM-Symbolic dataset of 12,500 problems, yielding 47,815 sense-labeled discourse relations over 11,414 successfully-aligned instances (91.3% pipeline yield). Our experiments demonstrate that incorporating Math-DB annotations into CoT prompts consistently improves LLM performance across various difficulty levels.
Anthology ID:
2026.law-main.7
Volume:
Proceedings of the 20th Linguistic Annotation Workshop (LAW XX)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Yang Janet Liu, Luke Gessler
Venues:
LAW | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
75–94
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.law-main.7/
DOI:
Bibkey:
Cite (ACL):
Mustafa Erolcan Er. 2026. Math-DB: A Discourse Framework for Mathematical Word Problems to Enhance LLM Reasoning. In Proceedings of the 20th Linguistic Annotation Workshop (LAW XX), pages 75–94, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Math-DB: A Discourse Framework for Mathematical Word Problems to Enhance LLM Reasoning (Er, LAW 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.law-main.7.pdf