Dynamic Collaboration of Multi-Language Models based on Minimal Complete Semantic Units

Chao Hao, Zezheng Wang, Yanhua Huang, Ruiwen Xu, Wenzhe Niu, Xin Liu, Zitong Yu


Abstract
This paper investigates the enhancement of reasoning capabilities in language models through token-level multi-model collaboration. Our approach selects the optimal tokens from the next token distributions provided by multiple models to perform autoregressive reasoning. Contrary to the assumption that more models yield better results, we introduce a distribution distance-based dynamic selection strategy (DDS) to optimize the multi-model collaboration process. To address the critical challenge of vocabulary misalignment in multi-model collaboration, we propose the concept of minimal complete semantic units (MCSU), which is simple yet enables multiple language models to achieve natural alignment within the linguistic space. Experimental results across various benchmarks demonstrate the superiority of our method. The codes will be released soon.
Anthology ID:
2025.emnlp-main.651
Volume:
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12905–12922
Language:
URL:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.651/
DOI:
Bibkey:
Cite (ACL):
Chao Hao, Zezheng Wang, Yanhua Huang, Ruiwen Xu, Wenzhe Niu, Xin Liu, and Zitong Yu. 2025. Dynamic Collaboration of Multi-Language Models based on Minimal Complete Semantic Units. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 12905–12922, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Dynamic Collaboration of Multi-Language Models based on Minimal Complete Semantic Units (Hao et al., EMNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.651.pdf
Checklist:
 2025.emnlp-main.651.checklist.pdf