ComSearch: Equation Searching with Combinatorial Strategy for Solving Math Word Problems with Weak Supervision
Qianying Liu, Wenyu Guan, Jianhao Shen, Fei Cheng, Sadao Kurohashi
Abstract
Previous studies have introduced a weakly-supervised paradigm for solving math word problems requiring only the answer value annotation. While these methods search for correct value equation candidates as pseudo labels, they search among a narrow sub-space of the enormous equation space. To address this problem, we propose a novel search algorithm with combinatorial strategy ComSearch, which can compress the search space by excluding mathematically equivalent equations. The compression allows the searching algorithm to enumerate all possible equations and obtain high-quality data. We investigate the noise in the pseudo labels that hold wrong mathematical logic, which we refer to as the false-matching problem, and propose a ranking model to denoise the pseudo labels. Our approach holds a flexible framework to utilize two existing supervised math word problem solvers to train pseudo labels, and both achieve state-of-the-art performance in the weak supervision task.- Anthology ID:
- 2023.eacl-main.186
- Volume:
- Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
- Month:
- May
- Year:
- 2023
- Address:
- Dubrovnik, Croatia
- Editors:
- Andreas Vlachos, Isabelle Augenstein
- Venue:
- EACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2549–2562
- Language:
- URL:
- https://aclanthology.org/2023.eacl-main.186
- DOI:
- 10.18653/v1/2023.eacl-main.186
- Cite (ACL):
- Qianying Liu, Wenyu Guan, Jianhao Shen, Fei Cheng, and Sadao Kurohashi. 2023. ComSearch: Equation Searching with Combinatorial Strategy for Solving Math Word Problems with Weak Supervision. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 2549–2562, Dubrovnik, Croatia. Association for Computational Linguistics.
- Cite (Informal):
- ComSearch: Equation Searching with Combinatorial Strategy for Solving Math Word Problems with Weak Supervision (Liu et al., EACL 2023)
- PDF:
- https://preview.aclanthology.org/add_acl24_videos/2023.eacl-main.186.pdf