Jiyuan Wang
2026
Graph Reasoning Paradigm: Structured and Symbolic Reasoning with Topology-Aware Reinforcement Learning for Large Language Models
Runxuan Liu | Xianhao Ou | Xinyan Ma | Jiyuan Wang | Jiafeng Liang | Jiaqi Li | Tao He | Zheng Chu | Rongchuan Mu | Zekun Wang | Baoxin Wang | Dayong Wu | Ming Liu | Shijin Wang | Guoping Hu | Bing Qin
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Runxuan Liu | Xianhao Ou | Xinyan Ma | Jiyuan Wang | Jiafeng Liang | Jiaqi Li | Tao He | Zheng Chu | Rongchuan Mu | Zekun Wang | Baoxin Wang | Dayong Wu | Ming Liu | Shijin Wang | Guoping Hu | Bing Qin
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Long Chain-of-Thought (LCoT), achieved by Reinforcement Learning with Verifiable Rewards (RLVR), has proven effective in enhancing the reasoning capabilities of Large Language Models (LLMs). However, reasoning in current LLMs is primarily generated as plain text, where performing semantic evaluation on such unstructured data creates a computational bottleneck during training. Despite RLVR-based optimization, existing methods still suffer from coarse-grained supervision, reward hacking, high training costs, and poor generalization.To address these issues, we propose the Graph Reasoning Paradigm (GRP), which realizes structured and symbolic reasoning, implemented via graph-structured representations with step-level cognitive labels. Building upon GRP, we further design Process-Aware Stratified Clipping Group Relative Policy Optimization (PASC-GRPO), which leverages structured evaluation to replace semantic evaluation, achieves process-aware verification through graph-structured outcome rewards, and mitigates reward hacking via stratified clipping advantage estimation. Experiments demonstrate significant improvements across mathematical reasoning and code generation tasks. Data, models, and code will be released later.
2025
From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalities
Shixin Jiang | Jiafeng Liang | Jiyuan Wang | Xuan Dong | Heng Chang | Weijiang Yu | Jinhua Du | Ming Liu | Bing Qin
Findings of the Association for Computational Linguistics: ACL 2025
Shixin Jiang | Jiafeng Liang | Jiyuan Wang | Xuan Dong | Heng Chang | Weijiang Yu | Jinhua Du | Ming Liu | Bing Qin
Findings of the Association for Computational Linguistics: ACL 2025
To tackle complex tasks in real-world scenarios, more researchers are focusing on Omni-MLLMs, which aim to achieve omni-modal understanding and generation. Beyond the constraints of any specific non-linguistic modality, Omni-MLLMs map various non-linguistic modalities into the embedding space of LLMs and enable the interaction and understanding of arbitrary combinations of modalities within a single model. In this paper, we systematically investigate relevant research and provide a comprehensive survey of Omni-MLLMs. Specifically, we first explain the four core components of Omni-MLLMs for unified multi-modal modeling with a meticulous taxonomy that offers novel perspectives. Then, we introduce the effective integration achieved through two-stage training and discuss the corresponding datasets as well as evaluation. Furthermore, we summarize the main challenges of current Omni-MLLMs and outline future directions. We hope this paper serves as an introduction for beginners and promotes the advancement of related research. Resources have been made publicly availableat https://github.com/threegold116/Awesome-Omni-MLLMs.