Abstract
Within Motivational Interviewing (MI), client utterances are coded as for or against a certain behaviour change, along with commitment strength; this is essential to ensure therapists soften rather than persisting goal-related actions in the face of resistance. Prior works in MI agents have been scripted or semi-scripted, limiting users’ natural language expressions. With the aim of automating the MI interactions, we propose and explore the task of automated identification of client motivational language. Employing Large Language Models (LLMs), we compare in-context learning (ICL) and instruction fine-tuning (IFT) with varying training sizes for this identification task. Our experiments show that both approaches can learn under low-resourced settings. Our results demonstrate that IFT, though cheaper, is more stable to prompt choice, and yields better performance with more data. Given the detected motivation, we further present an approach to the analysis of therapists’ strategies for balancing building rapport with clients with advancing the treatment plan. A framework of MI agents is developed using insights from the data and the psychotherapy literature.- Anthology ID:
- 2024.clpsych-1.3
- Volume:
- Proceedings of the 9th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2024)
- Month:
- March
- Year:
- 2024
- Address:
- St. Julians, Malta
- Editors:
- Andrew Yates, Bart Desmet, Emily Prud’hommeaux, Ayah Zirikly, Steven Bedrick, Sean MacAvaney, Kfir Bar, Molly Ireland, Yaakov Ophir
- Venues:
- CLPsych | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 23–40
- Language:
- URL:
- https://aclanthology.org/2024.clpsych-1.3
- DOI:
- Cite (ACL):
- Van Hoang, Eoin Rogers, and Robert Ross. 2024. How Can Client Motivational Language Inform Psychotherapy Agents?. In Proceedings of the 9th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2024), pages 23–40, St. Julians, Malta. Association for Computational Linguistics.
- Cite (Informal):
- How Can Client Motivational Language Inform Psychotherapy Agents? (Hoang et al., CLPsych-WS 2024)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2024.clpsych-1.3.pdf