When Consistency Becomes Bias: Interviewer Effects in Semi-Structured Clinical Interviews

Hasindri Sankalpana Watawana, Sergio Gastón Burdisso, Diego Aaron Moreno-Galvan, Fernando Sanchez-Vega, Adrian Pastor Lopez Monroy, Petr Motlicek, Esau Villatoro-Tello


Abstract
Automatic depression detection from doctor–patient conversations has gained momentum thanks to the availability of public corpora and advances in language modeling. However, interpretability remains limited: strong performance is often reported without revealing what drives predictions. We analyze three datasets—ANDROIDS, DAIC-WOZ, and E-DAIC—and identify a systematic bias from interviewer prompts in semi-structured interviews. Models trained on interviewer turns exploit fixed prompts and positions to distinguish depressed from control subjects, often achieving high classification scores without using participant language. Restricting models to participant utterances distributes decision evidence more broadly and reflects genuine linguistic cues. While semi-structured protocols ensure consistency, including interviewer prompts inflates performance by leveraging script artifacts. Our results highlight a cross-dataset, architecture-agnostic bias and emphasize the need for analyses that localize decision evidence by time and speaker to ensure models learn from participants’ language.
Anthology ID:
2026.lrec-main.185
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
2355–2361
Language:
URL:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.185/
DOI:
Bibkey:
Cite (ACL):
Hasindri Sankalpana Watawana, Sergio Gastón Burdisso, Diego Aaron Moreno-Galvan, Fernando Sanchez-Vega, Adrian Pastor Lopez Monroy, Petr Motlicek, and Esau Villatoro-Tello. 2026. When Consistency Becomes Bias: Interviewer Effects in Semi-Structured Clinical Interviews. International Conference on Language Resources and Evaluation, main:2355–2361.
Cite (Informal):
When Consistency Becomes Bias: Interviewer Effects in Semi-Structured Clinical Interviews (Watawana et al., LREC 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.185.pdf