ExTRA: Explainable Therapy-Related Annotations

Mat Rawsthorne, Tahseen Jilani, Jacob Andrews, Yunfei Long, Jeremie Clos, Samuel Malins, Daniel Hunt

Abstract
In this paper we report progress on a novel explainable artificial intelligence (XAI) initiative applying Natural Language Processing (NLP) with elements of codesign to develop a text classifier for application in psychotherapy training. The task is to produce a tool that will facilitate therapists to review their sessions by automatically labelling transcript text with levels of interaction for patient activation in known psychological processes, using XAI to increase their trust in the model’s suggestions and client trajectory predictions. After pre-processing of the language features extracted from professionally annotated therapy session transcripts, we apply a supervised machine learning approach (CHAID) to classify interaction labels (negative, neutral, positive). Weighted samples are used to overcome class imbalanced data. The results show this initial model can make useful distinctions among the three labels of patient activation with 74% accuracy and provide insight into its reasoning. This ongoing project will additionally evaluate which XAI approaches can be used to increase the transparency of the tool to end users, exploring whether direct involvement of stakeholders improves usability of the XAI interface and therefore trust in the solution.
Anthology ID:
2020.nl4xai-1.4
Volume:
2nd Workshop on Interactive Natural Language Technology for Explainable Artificial Intelligence
Month:
November
Year:
2020
Address:
Dublin, Ireland
Editors:
Jose M. Alonso, Alejandro Catala
Venue:
NL4XAI
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
11–15
Language:
URL:
https://aclanthology.org/2020.nl4xai-1.4
DOI:
Bibkey:
Cite (ACL):
Mat Rawsthorne, Tahseen Jilani, Jacob Andrews, Yunfei Long, Jeremie Clos, Samuel Malins, and Daniel Hunt. 2020. ExTRA: Explainable Therapy-Related Annotations. In 2nd Workshop on Interactive Natural Language Technology for Explainable Artificial Intelligence, pages 11–15, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
ExTRA: Explainable Therapy-Related Annotations (Rawsthorne et al., NL4XAI 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/improve-issue-templates/2020.nl4xai-1.4.pdf
PDF Search