Complex Numerical Reasoning with Numerical Semantic Pre-training Framework

Jun Zhang, Haihong E, Tianyi Hu, Yifan Zhu, Meina Song, Haoran Luo


Abstract
Multi-hop complex reasoning over incomplete knowledge graphs (KGs) has been extensively studied, but research on numerical knowledge graphs (NKGs) remains relatively limited. Recent approaches focus on separately encoding entities and numerical values, using neural networks to process query encodings for reasoning. However, in complex multi-hop reasoning tasks, numerical values are not merely symbols, and they carry specific semantics and logical relationships that must be accurately represented. The CNR-NST framework can perform binary operations on numerical attributes in NKGs, enabling it to infer new numerical attributes from existing knowledge. Our approach effectively handles up to 102 types of complex numerical reasoning queries. On three public datasets, CNR-NST demonstrates SOTA performance in complex numerical queries, achieving an average improvement of over 40% compared to existing methods. Notably, this work expands the query types for complex multi-hop numerical reasoning and introduces a new evaluation metric for numerical answers, which has been validated through comprehensive experiments.
Anthology ID:
2025.emnlp-main.782
Volume:
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
15491–15525
Language:
URL:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.782/
DOI:
Bibkey:
Cite (ACL):
Jun Zhang, Haihong E, Tianyi Hu, Yifan Zhu, Meina Song, and Haoran Luo. 2025. Complex Numerical Reasoning with Numerical Semantic Pre-training Framework. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 15491–15525, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Complex Numerical Reasoning with Numerical Semantic Pre-training Framework (Zhang et al., EMNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.782.pdf
Checklist:
 2025.emnlp-main.782.checklist.pdf