A Unified Framework for Modeling Heterogeneous Financial Data via Dual-Granularity Prompting

Yu Lei, Zixuan Wang, Yiqing Feng, Junru Zhang, Yahui Li, LIU Chu, Wang Tongyao, Dongyang Li


Abstract
Recent industrial credit scoring models remain heavily reliant on manually tuned statistical learning methods. Despite their potential, deep learning architectures have struggled to consistently outperform traditional statistical models in industrial credit scoring, largely due to the complexity of heterogeneous financial data and the challenge of modeling evolving creditworthiness. To bridge this gap, we introduce FinLangNet, a novel framework that reformulates credit scoring as a multi-scale sequential learning problem. FinLangNet processes heterogeneous financial data through a dual-module architecture that combines tabular feature extraction with temporal sequence modeling, generating probability distributions of users’ future financial behaviors across multiple time horizons. A key innovation is our dual-prompt mechanism within the sequential module, which introduces learnable prompts operating at both feature-level granularity for capturing fine-grained temporal patterns and user-level granularity for aggregating holistic risk profiles. Notably, real world deployment yielded a 6.3 pp improvement in KS, along with a 9.9% reduction in bad debt rate.
Anthology ID:
2026.acl-industry.43
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Yunyao Li, Georg Rehm, Mei Tu
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
618–631
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-industry.43/
DOI:
Bibkey:
Cite (ACL):
Yu Lei, Zixuan Wang, Yiqing Feng, Junru Zhang, Yahui Li, LIU Chu, Wang Tongyao, and Dongyang Li. 2026. A Unified Framework for Modeling Heterogeneous Financial Data via Dual-Granularity Prompting. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026), pages 618–631, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
A Unified Framework for Modeling Heterogeneous Financial Data via Dual-Granularity Prompting (Lei et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-industry.43.pdf