Minghua He
2026
d-TreeRPO: Towards More Reliable Policy Optimization for Diffusion Language Models
Leyi Pan | Shuchang Tao | Yunpeng Zhai | Zheyu Fu | Liancheng Fang | Minghua He | Lingzhe Zhang | Zhaoyang Liu | Bolin Ding | Aiwei Liu | Lijie Wen
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Leyi Pan | Shuchang Tao | Yunpeng Zhai | Zheyu Fu | Liancheng Fang | Minghua He | Lingzhe Zhang | Zhaoyang Liu | Bolin Ding | Aiwei Liu | Lijie Wen
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Reinforcement learning (RL) is pivotal for enhancing the reasoning capabilities of diffusion large language models (dLLMs). However, existing dLLM policy optimization methods suffer from two critical reliability bottlenecks: (1) reward sparsity, arising from coarse or unverifiable signals that impede accurate advantage calculation; and (2) their probability estimates do not account for the gap to the unbiased expectation over all decoding orders, which are intractable to compute. To mitigate these issues, we propose d-TreeRPO, a reliable RL framework for dLLMs that leverages tree-structured rollouts and bottom-up advantage computation based on verifiable outcome rewards to provide fine-grained and verifiable step-wise reward signals. Furthermore, we provide a theoretical proof demonstrating that increasing prediction confidence effectively minimizes the gap between unbiased expected prediction probabilities and its single-step forward pass estimate. Guided by this analysis, we introduce a time-scheduled self-distillation loss during training that enhances prediction confidence in later training stages, thereby enabling more accurate probability estimation and better performance. Experiments demonstrate that d-TreeRPO outperforms existing baselines and achieves significant improvements across multiple reasoning benchmarks. Specifically, it achieves +86.2% on Sudoku, +51.6% on Countdown, +4.5% on GSM8K, and +5.3% on Math500 compared to the base model.
DUET: Joint Exploration of User–Item Profiles in Recommendation System
Yue Chen | Yifei Sun | Lu Wang | Fangkai Yang | Pu Zhao | Minjie Hong | Yifei Dong | Minghua He | Nan Hu | Jianjin Zhang | Zhiwei Dai | Yuefeng Zhan | Weihao Han | Hao Sun | Qingwei Lin | Weiwei Deng | Feng Sun | Qi Zhang | Saravan Rajmohan | Dongmei Zhang
Findings of the Association for Computational Linguistics: ACL 2026
Yue Chen | Yifei Sun | Lu Wang | Fangkai Yang | Pu Zhao | Minjie Hong | Yifei Dong | Minghua He | Nan Hu | Jianjin Zhang | Zhiwei Dai | Yuefeng Zhan | Weihao Han | Hao Sun | Qingwei Lin | Weiwei Deng | Feng Sun | Qi Zhang | Saravan Rajmohan | Dongmei Zhang
Findings of the Association for Computational Linguistics: ACL 2026
Traditional recommendation systems represent users and items as dense vectors and learn to align them in a shared latent space for relevance estimation. Recent LLM-based recommenders instead leverage natural-language representations that are easier to interpret and integrate with downstream reasoning modules. This paper studies how to construct effective textual profiles for users and items, and how to align them for recommendation.A central difficulty is that the best profile format is not known a priori: manually designed templates can be brittle and misaligned with task objectives. Moreover, generating user and item profiles independently may produce descriptions that are individually plausible yet semantically inconsistent for a specific user–item pair. We propose Duet, an interaction-aware profile generator that jointly produces user and item profiles conditioned on both user history and item evidence. Duet follows a three-stage procedure: it first turns raw histories and metadata into compact cues, then expands these cues into paired profile prompts and then generate profiles, and finally optimizes the generation policy with reinforcement learning using downstream recommendation performance as feedback. Experiments on three real-world datasets show that Duet consistently outperforms strong baselines, demonstrating the benefits of template-free profile exploration and joint user–item textual alignment. Project page: https://duet-rec.github.io/.
2025
ExeCoder: Empowering Large Language Models with Executability Representation for Code Translation
Minghua He | Yue Chen | Fangkai Yang | Pu Zhao | Wenjie Yin | Yu Kang | Qingwei Lin | Saravan Rajmohan | Dongmei Zhang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Minghua He | Yue Chen | Fangkai Yang | Pu Zhao | Wenjie Yin | Yu Kang | Qingwei Lin | Saravan Rajmohan | Dongmei Zhang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Code translation is a crucial activity in the software development and maintenance process, and researchers have recently begun to focus on using pre-trained large language models (LLMs) for code translation. However, existing LLMs only learn the contextual semantics of code during pre-training, neglecting executability information closely related to the execution state of the code, which results in unguaranteed code executability and unreliable automated code translation. To address this issue, we propose ExeCoder, an LLM specifically designed for code translation, aimed at utilizing executability representations such as functional semantics, syntax structures, and variable dependencies to enhance the capabilities of LLMs in code translation. To evaluate the effectiveness of ExeCoder, we manually enhanced the widely used benchmark TransCoder-test, resulting in a benchmark called TransCoder-test-X that serves LLMs. Evaluation of TransCoder-test-X indicates that ExeCoder achieves state-of-the-art performance in code translation, surpassing existing open-source code LLMs by over 10.88% to 38.78% and over 27.44% to 42.97% on two metrics, and even outperforms the renowned closed-source LLM GPT-4o. Code is available at https://aka.ms/execoder
Search
Fix author
Co-authors
- Yue Chen 2
- Qingwei Lin 2
- Saravan Rajmohan 2
- Fangkai Yang 2
- Dongmei Zhang 2
- Pu Zhao 2
- Zhiwei Dai 1
- Weiwei Deng 1
- Bolin Ding 1
- Yifei Dong 1
- Liancheng Fang 1
- Zheyu Fu 1
- Weihao Han 1
- Minjie Hong 1
- Nan Hu 1
- Yu Kang 1
- Zhaoyang Liu 1
- Aiwei Liu 1
- Leyi Pan 1
- Yifei Sun 1
- Hao Sun 1
- Feng Sun 1
- Shuchang Tao 1
- Lu Wang 1
- Lijie Wen 1
- Wenjie Yin 1
- Yunpeng Zhai 1
- Yuefeng Zhan 1
- Lingzhe Zhang 1
- Jianjin Zhang 1
- Qi Zhang 1