Dialogue is Better Than Monologue: Instructing Meidcal LLMs via Strategic Conversations

Zijie Liu, Xinyu Zhao, Jie Peng, Jinhao Duan, Zhuangdi Zhu, Qingyu Chen, Kaidi Xu, Xia Hu, Tianlong Chen


Abstract
In real clinical practice, clinicians must sift through noisy and often conflicting information, progressively gathering and sequencing evidence before reaching conclusions. However, existing tuning methods for medical AI models are typically monologue-based — that is, models are fine-tuned on static question answering (QA) tasks or medical articles, which fail to reflect the interactive and iterative nature of clinical reasoning. To bridge this gap, we introduce MuddyMaze, a benchmark designed to expose the limitations of current monologue-based tuning, and construct a large dialogue dataset of 22.2k doctor–patient interactions that capture stepwise diagnostic reasoning validated by medical experts. Building on those, we propose dialogue-tuning, a new fine-tuning paradigm that captures the internal reasoning dynamics unfolding across interactions.To assess the effectiveness of our approach, we evaluated dialogue-tuned models on MuddyMaze, where they outperform monologue-tuned baselines (e.g., MedQA) by +16.1% in one-round and +4.1% in multi-round evidence ranking, while maintaining or even improving accuracy on standard medical QA benchmarks (e.g., PubMedQA). These results indicate that dialogue-tuning not only enhances reasoning robustness and evidence integration but also preserves the factual precision of traditional QA performance.
Anthology ID:
2026.findings-eacl.149
Volume:
Findings of the Association for Computational Linguistics: EACL 2026
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2858–2872
Language:
URL:
https://preview.aclanthology.org/ingest-latest-mitpress-cl-tacl/2026.findings-eacl.149/
DOI:
10.18653/v1/2026.findings-eacl.149
Bibkey:
Cite (ACL):
Zijie Liu, Xinyu Zhao, Jie Peng, Jinhao Duan, Zhuangdi Zhu, Qingyu Chen, Kaidi Xu, Xia Hu, and Tianlong Chen. 2026. Dialogue is Better Than Monologue: Instructing Meidcal LLMs via Strategic Conversations. In Findings of the Association for Computational Linguistics: EACL 2026, pages 2858–2872, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
Dialogue is Better Than Monologue: Instructing Meidcal LLMs via Strategic Conversations (Liu et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-latest-mitpress-cl-tacl/2026.findings-eacl.149.pdf
Checklist:
 2026.findings-eacl.149.checklist.pdf