CHiRPE: A Step Towards Real-World Clinical NLP with Clinician-Oriented Model Explanations

Stephanie Fong, Zimu Wang, Guilherme C Oliveira, Xiangyu Zhao, Yiwen Jiang, Jiahe Liu, Beau-Luke Colton, Scott W. Woods, Martha Shenton, Barnaby Nelson, Zongyuan Ge, Dominic Dwyer


Abstract
The medical adoption of NLP tools requires interpretability by end users, yet traditional explainable AI (XAI) methods are misaligned with clinical reasoning and lack clinician input. We introduce CHiRPE (Clinical High-Risk Prediction with Explainability), an NLP pipeline that takes transcribed semi-structured clinical interviews to: (i) predict psychosis risk; and (ii) generate novel SHAP explanation formats co-developed with clinicians. Trained on 944 semi-structured interview transcripts across 24 international clinics of the AMP-SCZ study, the CHiRPE pipeline integrates symptom-domain mapping, LLM summarisation, and BERT classification. CHiRPE achieved over 90% accuracy across three BERT variants and outperformed baseline models. Explanation formats were evaluated by 28 clinical experts who indicated a strong preference for our novel concept-guided explanations, especially hybrid graph-and-text summary formats. CHiRPE demonstrates that clinically-guided model development produces both accurate and interpretable results. Our next step is focused on real-world testing across our 24 international sites.
Anthology ID:
2026.eacl-short.46
Volume:
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 2: Short Papers)
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
646–658
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-short.46/
DOI:
Bibkey:
Cite (ACL):
Stephanie Fong, Zimu Wang, Guilherme C Oliveira, Xiangyu Zhao, Yiwen Jiang, Jiahe Liu, Beau-Luke Colton, Scott W. Woods, Martha Shenton, Barnaby Nelson, Zongyuan Ge, and Dominic Dwyer. 2026. CHiRPE: A Step Towards Real-World Clinical NLP with Clinician-Oriented Model Explanations. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 2: Short Papers), pages 646–658, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
CHiRPE: A Step Towards Real-World Clinical NLP with Clinician-Oriented Model Explanations (Fong et al., EACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-short.46.pdf
Checklist:
 2026.eacl-short.46.checklist.pdf