Ann King
2025
Automated Scoring of Communication Skills in Physician-Patient Interaction: Balancing Performance and Scalability
Saed Rezayi
|
Le An Ha
|
Yiyun Zhou
|
Andrew Houriet
|
Angelo D’Addario
|
Peter Baldwin
|
Polina Harik
|
Ann King
|
Victoria Yaneva
Proceedings of the 20th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2025)
This paper presents an automated scoring approach for a formative assessment tool aimed at helping learner physicians enhance their communication skills through simulated patient interactions. The system evaluates transcribed learner responses by detecting key communicative behaviors, such as acknowledgment, empathy, and clarity. Built on an adapted version of the ACTA scoring framework, the model achieves a mean binary F1 score of 0.94 across 8 clinical scenarios. A central contribution of this work is the investigation of how to balance scoring accuracy with scalability. We demonstrate that synthetic training data offers a promising path toward reducing reliance on large, annotated datasets—making automated scoring more accurate and scalable.
Search
Fix author
Co-authors
- Peter Baldwin 1
- Angelo D’Addario 1
- Le An Ha 1
- Polina Harik 1
- Andrew Houriet 1
- show all...