From Query to Counsel: Structured Reasoning with a Multi-Agent Framework and Dataset for Legal Consultation

Mingfei Lu, Yi Zhang, Mengjia Wu, Yue Feng


Abstract
Legal consultation question answering (Legal CQA) presents unique challenges compared to traditional legal QA tasks, including the scarcity of high-quality training data, complex task composition, and strong contextual dependencies. To address these, we construct JurisCQAD, a large-scale dataset of over 43,000 real-world Chinese legal queries annotated with expert-validated positive and negative responses, and design a structured task decomposition that converts each query into a legal element graph integrating entities, events, intents, and legal issues. We further propose JurisMA, a modular multi-agent framework supporting dynamic routing, statutory grounding, and stylistic optimization. Combined with the element graph, the framework enables strong context-aware reasoning, effectively capturing dependencies across legal facts, norms, and procedural logic. Trained on JurisCQAD and evaluated on a refined LawBench, our system significantly outperforms both general-purpose and legal-domain LLMs across multiple lexical and semantic metrics, demonstrating the benefits of interpretable decomposition and modular collaboration in Legal CQA.
Anthology ID:
2026.acl-long.776
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
17064–17078
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.776/
DOI:
Bibkey:
Cite (ACL):
Mingfei Lu, Yi Zhang, Mengjia Wu, and Yue Feng. 2026. From Query to Counsel: Structured Reasoning with a Multi-Agent Framework and Dataset for Legal Consultation. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 17064–17078, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
From Query to Counsel: Structured Reasoning with a Multi-Agent Framework and Dataset for Legal Consultation (Lu et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.776.pdf
Checklist:
 2026.acl-long.776.checklist.pdf