A Layered Debating Multi-Agent System for Similar Disease Diagnosis

Yutian Zhao, Huimin Wang, Yefeng Zheng, Xian Wu


Abstract
Distinguishing between extremely similar diseases is a critical and challenging aspect of clinical decision-making. Traditional classification, contrastive learning, and Large Language Models (LLMs) based methods fail to detect the subtle clues necessary for differentiation. This task demands complex reasoning and a variety of tools to identify minor differences and make informed decisions. This paper probes a novel framework that leverages LLMs and a multi-agent system to achieve accurate disease diagnosis through a process of repeated debate and reassessment. The approach aims to identify subtle differences between similar disease candidates. We structure patient information and integrate extensive medical knowledge to guide the analysis towards discerning these differences for precise diagnosis. Comprehensive experiments were conducted on two public datasets and two newly introduced datasets, JarvisD2-Chinese and JarvisD2-English, to validate the effectiveness of our method. The results confirm the efficacy of our approach, demonstrating its potential to enhance diagnostic precision in healthcare.
Anthology ID:
2025.naacl-short.46
Volume:
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers)
Month:
April
Year:
2025
Address:
Albuquerque, New Mexico
Editors:
Luis Chiruzzo, Alan Ritter, Lu Wang
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
539–549
Language:
URL:
https://preview.aclanthology.org/moar-dois/2025.naacl-short.46/
DOI:
10.18653/v1/2025.naacl-short.46
Bibkey:
Cite (ACL):
Yutian Zhao, Huimin Wang, Yefeng Zheng, and Xian Wu. 2025. A Layered Debating Multi-Agent System for Similar Disease Diagnosis. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers), pages 539–549, Albuquerque, New Mexico. Association for Computational Linguistics.
Cite (Informal):
A Layered Debating Multi-Agent System for Similar Disease Diagnosis (Zhao et al., NAACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/moar-dois/2025.naacl-short.46.pdf