Investigating Math Word Problems using Pretrained Multilingual Language Models

Minghuan Tan, Lei Wang, Lingxiao Jiang, Jing Jiang


Abstract
In this paper, we revisit math word problems (MWPs) from the cross-lingual and multilingual perspective. We construct our MWP solvers over pretrained multilingual language models using the sequence-to-sequence model with copy mechanism. We compare how the MWP solvers perform in cross-lingual and multilingual scenarios. To facilitate the comparison of cross-lingual performance, we first adapt the large-scale English dataset MathQA as a counterpart of the Chinese dataset Math23K. Then we extend several English datasets to bilingual datasets through machine translation plus human annotation. Our experiments show that the MWP solvers may not be transferred to a different language even if the target expressions share the same numerical constants and operator set. However, it can be better generalized if problem types exist on both source language and target language.
Anthology ID:
2022.mathnlp-1.2
Volume:
Proceedings of the 1st Workshop on Mathematical Natural Language Processing (MathNLP)
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates (Hybrid)
Editors:
Deborah Ferreira, Marco Valentino, Andre Freitas, Sean Welleck, Moritz Schubotz
Venue:
MathNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7–16
Language:
URL:
https://aclanthology.org/2022.mathnlp-1.2
DOI:
10.18653/v1/2022.mathnlp-1.2
Bibkey:
Cite (ACL):
Minghuan Tan, Lei Wang, Lingxiao Jiang, and Jing Jiang. 2022. Investigating Math Word Problems using Pretrained Multilingual Language Models. In Proceedings of the 1st Workshop on Mathematical Natural Language Processing (MathNLP), pages 7–16, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
Cite (Informal):
Investigating Math Word Problems using Pretrained Multilingual Language Models (Tan et al., MathNLP 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/naacl-24-ws-corrections/2022.mathnlp-1.2.pdf
Video:
 https://preview.aclanthology.org/naacl-24-ws-corrections/2022.mathnlp-1.2.mp4