MultiLingPoT: Boosting Mathematical Reasoning in LLMs through Multilingual Program Integration

Nianqi Li, Zujie Liang, Siyu Yuan, Jiaqing Liang, Feng Wei, Yanghua Xiao


Abstract
Program-of-Thought, which aims to use program instead of natural language in reasoning, is an important way for LLMs to solve mathematical problems. Since different programming languages excel in different areas, it is natural to use the most suitable language for solving specific problems. However, current research only focuses on single language PoT, ignoring the differences between programming languages. Therefore, this paper proposes a multilingual programme reasoning method, MultiLingPoT, and deeply explores the impact of multilingual integration in the training and inference. This method allows the model to answer questions using multiple languages by fine-tuning on multilingual data and improving individual language’s reasoning accuracy by 2.5%. Additionally, prior and posterior selection methods are used to help the model select the most suitable language during inference, and achieves 8% performance gains. Finally, our code metric analysis shows that language differences manifest in encapsulation levels and implementation granularity, while strategic deviation from language conventions can enhances code performance.
Anthology ID:
2025.findings-emnlp.1079
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
19794–19811
Language:
URL:
https://preview.aclanthology.org/ingest-luhme/2025.findings-emnlp.1079/
DOI:
10.18653/v1/2025.findings-emnlp.1079
Bibkey:
Cite (ACL):
Nianqi Li, Zujie Liang, Siyu Yuan, Jiaqing Liang, Feng Wei, and Yanghua Xiao. 2025. MultiLingPoT: Boosting Mathematical Reasoning in LLMs through Multilingual Program Integration. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 19794–19811, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
MultiLingPoT: Boosting Mathematical Reasoning in LLMs through Multilingual Program Integration (Li et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-luhme/2025.findings-emnlp.1079.pdf
Checklist:
 2025.findings-emnlp.1079.checklist.pdf