Compartmentalised Agentic Reasoning for Clinical NLI

Mael Jullien, Andre Freitas, Marco Valentino, Lei Xu


Abstract
Large language models can produce fluent judgments for clinical natural language inference, yet they frequently fail when the decision requires the correct inferential schema rather than surface matching. We introduce CARENLI, a compartmentalised agentic framework that routes each premise–statement pair to a reasoning family and then applies a specialised solver with explicit verification and targeted refinement. We evaluate on an expanded CTNLI benchmark of 200 instances spanning four reasoning families: Causal Attribution, Compositional Grounding, Epistemic Verification, and Risk State Abstraction. Across four contemporary backbones models, CARENLI improves mean accuracy from about 23% with direct prompting to about 57%, a gain of roughly 34 points, with the largest benefits on structurally demanding reasoning types. These results support compartmentalisation plus verification as a practical route to more reliable and auditable clinical inference.
Anthology ID:
2026.findings-acl.545
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11205–11233
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.545/
DOI:
Bibkey:
Cite (ACL):
Mael Jullien, Andre Freitas, Marco Valentino, and Lei Xu. 2026. Compartmentalised Agentic Reasoning for Clinical NLI. In Findings of the Association for Computational Linguistics: ACL 2026, pages 11205–11233, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Compartmentalised Agentic Reasoning for Clinical NLI (Jullien et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.545.pdf
Checklist:
 2026.findings-acl.545.checklist.pdf