Zhihui Lu
2026
Rethinking Multiple-Choice Questions for RLVR: Unlocking Potential via Distractor Design
Xu Guo | Qiming Ge | Jian Tong | Kedi Chen | Jin Zhang | Xiaogui Yang | Xuan Gao | Haijun Lv | Zhihui Lu | Yicheng Zou | Qipeng Guo
Findings of the Association for Computational Linguistics: ACL 2026
Xu Guo | Qiming Ge | Jian Tong | Kedi Chen | Jin Zhang | Xiaogui Yang | Xuan Gao | Haijun Lv | Zhihui Lu | Yicheng Zou | Qipeng Guo
Findings of the Association for Computational Linguistics: ACL 2026
Reinforcement Learning with Verifiable Rewards (RLVR) significantly enhances the reasoning capabilities of Large Language Models. When applied to RLVR, Multiple-Choice Questions (MCQs) offer a scalable source of verifiable data but risk inducing reward hacking, where models shortcut reasoning via random guessing or simple elimination. Current approaches often mitigate this by converting MCQs to open-ended formats, thereby discarding the contrastive signal provided by expert-designed distractors. In this work, we systematically investigate the impact of option design on RLVR. Our analysis highlights two primary insights: (1) Mismatches in option counts between training and testing degrade performance. (2) Strong distractors effectively mitigate random guessing, enabling effective RLVR training even with 2-way questions. Motivated by these findings, we propose Iterative Distractor Curation (IDC), a framework that actively constructs high-quality distractors to block elimination shortcuts and promote deep reasoning. Experiments on various benchmarks demonstrate that our method effectively enhances distractor quality and yields significant gains in RLVR training compared to the original data.
LatentRefusal: Latent-Signal Refusal for Unanswerable Text-to-SQL Queries
Xuancheng Ren | Shijing Hu | Zhihui Lu | Jiangqi Huang | Qiang Duan
Findings of the Association for Computational Linguistics: ACL 2026
Xuancheng Ren | Shijing Hu | Zhihui Lu | Jiangqi Huang | Qiang Duan
Findings of the Association for Computational Linguistics: ACL 2026
In LLM-based Text-to-SQL systems, unanswerable and underspecified user queries may generate not only incorrect text but also executable programs that yield misleading results or violate safety constraints, thus posing a major barrier to safe deployment. Existing refusal strategies for such queries either rely on output-level instruction following, which is brittle due to model hallucinations, or on estimating output uncertainty, which adds complexity and overhead. To address this challenge, we first formalize safe refusal in Text-to-SQL systems as an answerability-gating problem, and then propose **LatentRefusal**, a latent-signal refusal mechanism that predicts query answerability from intermediate hidden activations of an LLM. We introduce the Tri-Residual Gated Encoder (TRGE), a lightweight probing architecture, to suppress schema noise and amplify sparse, localized question–schema mismatch cues that indicate unanswerability. Extensive empirical evaluations across diverse ambiguous and unanswerable settings, together with ablations and interpretability analyses, demonstrate the effectiveness of the proposed scheme and show that **LatentRefusal** provides an attachable, efficient safety layer for Text-to-SQL systems. Across four benchmarks, **LatentRefusal** achieves an average F1 of 88.5% and 88.8% on Llama-3.1-8B and Qwen-3-8B respectively, while adding ~2ms probe overhead.