Yinuo Wang
2026
ConMA : Confidence-Guided Kernel Sampling with Multi-Stage Aggregation for LLM Reasoning
Yinuo Wang | Qingjie Li | Wenyao Cui | Qiuchi Li | Zhang Huaping
Findings of the Association for Computational Linguistics: ACL 2026
Yinuo Wang | Qingjie Li | Wenyao Cui | Qiuchi Li | Zhang Huaping
Findings of the Association for Computational Linguistics: ACL 2026
Test-time scaling (TTS) enhances LLM reasoning capabilities by sampling and aggregating diverse solution trajectories. However, existing approaches often rely on external verifiers and one-shot independent sampling, which results in inefficient budget allocation and underutilizes interim high-quality trajectories. We propose ConMA, a training-free, verifier-free TTS framework that reallocates a fixed inference budget into iterative sample–filter–diversify–select cycles: it filters answer groups based on intrinsic token-probability confidence, enriches candidates through diversity-aware expansion, and employs repeated single-choice selection for multi-stage refinement. Across multiple benchmarks, ConMA consistently improves accuracy under fixed budgets. With a maximum budget of N=64, ConMA boosts Qwen3-4B to 80% accuracy on AIME25, significantly outperforming strong baselines while converging early with only 18 samples on average, substantially reducing inference cost.
2025
Trustworthy Medical Question Answering: An Evaluation-Centric Survey
Yinuo Wang | Baiyang Wang | Robert Mercer | Frank Rudzicz | Sudipta Singha Roy | Pengjie Ren | Zhumin Chen | Xindi Wang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Yinuo Wang | Baiyang Wang | Robert Mercer | Frank Rudzicz | Sudipta Singha Roy | Pengjie Ren | Zhumin Chen | Xindi Wang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Trustworthiness in healthcare question-answering (QA) systems is important for ensuring patient safety, clinical effectiveness, and user confidence. As large language models (LLMs) become increasingly integrated into medical settings, the reliability of their responses directly influences clinical decision-making and patient outcomes. However, achieving comprehensive trustworthiness in medical QA poses significant challenges due to the inherent complexity of healthcare data, the critical nature of clinical scenarios, and the multifaceted dimensions of trustworthy AI. In this survey, we systematically examine six key dimensions of trustworthiness in medical QA, i.e., Factuality, Robustness, Fairness, Safety, Explainability, and Calibration. We review how each dimension is evaluated in existing LLM-based medical QA systems. We compile and compare major benchmarks designed to assess these dimensions and analyze evaluation-guided techniques that drive model improvements, such as retrieval-augmented grounding, adversarial fine-tuning, and safety alignment. Finally, we identify open challenges—such as scalable expert evaluation, integrated multi-dimensional metrics, and real-world deployment studies—and propose future research directions to advance the safe, reliable, and transparent deployment of LLM-powered medical QA.