Mingyu Liu
Also published as: MingYu Liu
2026
Nash-Pruned CredMAS: Dynamic Panel Pruning for VLM-MAS using Nash-based Selection and Doubly-Robust Credits
Yijia Fan | Mingyu Liu | Jing Yang | Jian Wang | Keze Wang | Jusheng Zhang
Findings of the Association for Computational Linguistics: ACL 2026
Yijia Fan | Mingyu Liu | Jing Yang | Jian Wang | Keze Wang | Jusheng Zhang
Findings of the Association for Computational Linguistics: ACL 2026
Multi-round Vision-Language Model (VLM) Multi-Agent Systems (MAS) offer powerful reasoning capabilities but suffer from prohibitive costs due to static panel designs, where all N agents communicate at every T round. This approach is fundamentally inefficient, as it ignores the context-dependent and diminishing marginal utility of specific agents. To address this, we propose Nash-CredMAS, an economic framework that transforms agent selection into a dynamic resource allocation game. Unlike heuristic routing or one-time pruning, our method operates in two phases: (1) Offline Causal Value Learning, where we employ a doubly-robust (AIPW) estimator to train a context-aware value function from biased interaction logs, effectively learning the true marginal contribution of agents; and (2) Online Dynamic Auctions, where agents bid for communication slots based on their predicted utility. We formulate the inference-time selection as a submodular maximization problem under budget constraints, theoretically guaranteeing a (1 - 1/e)-approximation of the optimal coalition via a greedy strategy. Empirically, Nash-CredMAS achieves state-of-the-art results on challenging benchmarks, including MMMU and V*-Bench, while reducing token consumption by over 25% compared to static baselines. The system naturally converges to an economic equilibrium where agents actively remain silent when their marginal value does not justify the cost.
Reinforcement Learning for Diffusion LLMs via Energy-Based Gibbs Alignment
Yijia Fan | Jing Yang | Mingyu Liu | Kaitong Cai | Jian Wang | Keze Wang | Jusheng Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yijia Fan | Jing Yang | Mingyu Liu | Kaitong Cai | Jian Wang | Keze Wang | Jusheng Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Diffusion Large Language Models (dLLMs) have emerged as a promising non-autoregressive paradigm for text generation, offering parallel decoding and bidirectional context modeling. However, aligning dLLMs with reinforcement learning (RL) remains a significant challenge, as the marginal likelihood of sequences in masked diffusion is typically intractable, rendering standard policy gradient methods unstable or computationally prohibitive. In this work, we propose **Diffusion-Gibbs Alignment (DGA)**, a novel variational framework that reformulates RL for dLLMs as a distribution matching problem. DGA bypasses the explicit computation of log-probabilities by leveraging a learned energy function to model the relative quality of samples. The optimization is decoupled into two stable steps: (1) contrastive energy ranking to capture global reward structures, and (2) weighted diffusion alignment to update the policy via importance sampling. Empirically, DGA establishes a new state-of-the-art across logical reasoning (Sudoku, Countdown), mathematical reasoning (GSM8K, Math500), and code generation (HumanEval, MBPP) benchmarks. DGA offers a novel variational perspective for dLLM alignment, achieving better performance while simultaneously enhancing training speed and memory efficiency.
On-Policy Self-Distillation for Efficient Diffusion Language Models with Early-Stage Calibration
Huaisheng Zhu | MingYu Liu | Junze Liu | Zhen Ge | Tian Wang | Jiri Gesi | Dakuo Wang | Weiqi Zhang | Houyu Zhang | Yufan Guo | Xian Li | Bing Yin | Sujay Sanghavi
Findings of the Association for Computational Linguistics: ACL 2026
Huaisheng Zhu | MingYu Liu | Junze Liu | Zhen Ge | Tian Wang | Jiri Gesi | Dakuo Wang | Weiqi Zhang | Houyu Zhang | Yufan Guo | Xian Li | Bing Yin | Sujay Sanghavi
Findings of the Association for Computational Linguistics: ACL 2026
Diffusion Large Language Models (DLLMs) have recently achieved strong performance, e.g., masked diffusion models (MDMs) can surpass autoregressive models (ARMs) in various tasks. However, DLLMs often struggle with inaccurate early-stage predictions due to limited context, which hinders both the model’s inference efficiency and the output’s overall quality. We propose Calibrated On-Policy Self-Distillation (COPSD) for DLLMs, a simple and efficient method to calibrate early token predictions without requiring demonstration data. COPSD distills an unnormalized target distribution derived from later decoding steps into the original model, enabling more accurate early predictions during inference. Experiments on math, planning, and RLHF tasks show that COPSD improves both effectiveness and efficiency, and further enhances performance when combined with supervised fine-tuning.
CCTVBench: Contrastive Consistency Traffic VideoQA Benchmark for Multimodal LLMs
Xingcheng Zhou | Hao Guo | Rui Song | Walter Zimmer | Mingyu Liu | Andr\'e Schamschurko | Hu Cao | Alois Knoll
Findings of the Association for Computational Linguistics: ACL 2026
Xingcheng Zhou | Hao Guo | Rui Song | Walter Zimmer | Mingyu Liu | Andr\'e Schamschurko | Hu Cao | Alois Knoll
Findings of the Association for Computational Linguistics: ACL 2026
Safety-critical traffic reasoning requires contrastive consistency: models must detect true hazards when an accident occurs, and reliably reject plausible-but-false hypotheses under near-identical counterfactual scenes. We present CCTVBench, a Contrastive Consistency Traffic VideoQA Benchmark built on paired real accident videos and world-model-generated counterfactual counterparts, together with minimally different, mutually exclusive hypothesis questions. CCTVBench enforces a single structured decision pattern over each video question quadruple and provides actionable diagnostics that decompose failures into positive omission, positive swap, negative hallucination, and mutual-exclusivity violation, while separating video versus question consistency. Experiments across open-source and proprietary video LLMs reveal a large and persistent gap between standard per-instance QA metrics and quadruple-level contrastive consistency, with unreliable none-of-the-above rejection as a key bottleneck. Finally, we introduce C-TCD, which leverages the semantically exclusive counterpart video as the contrast input at inference time, improving both instance-level QA and contrastive consistency.