Exploration of Perceptual Speech Features for Clinical Decision-Support in Mental Health Care
Vassilis Lyberatos, Edmund Dervakos, Eleni Adamidi, Athanasios Voulodimos, Giorgos Stamou
Abstract
Speech and language technologies offer valuable opportunities for supporting mental health assessment through objective and interpretable cues. We present a systematic feature-based analysis framework leveraging perceptually grounded acoustic and linguistic characteristics, including prosody, vocal quality, semantic coherence, syntactic structure, and sarcasm. Using statistical analysis and interpretable machine learning (XGBoost with SHAP and LIME), we examine associations between speech features and validated symptom measures of depression, anxiety, and ADHD. Evaluated on both controlled benchmark datasets (StressID, DAIC-WOZ, Androids, EATD) and a real-world clinical dataset, the framework reveals stable and consistent relationships between symptom severity and vocal irregularities (e.g., shimmer, jitter), lexical–syntactic patterns, and affective tone. An ablation study conducted across all datasets further identifies the most informative feature groups. This work explores a transparent and clinically interpretable approach to speech-based mental health analysis.- Anthology ID:
- 2026.clpsych-1.15
- Volume:
- Proceedings of the 10th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Aya Zirikly, Kfir Bar, Sean MacAvaney, Molly Ireland, Yaakov Ophir, Dana Atzil-Slonim, Vasudha Varadarajan, Steven Bedrick, Bart Desmet
- Venues:
- CLPsych | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 188–207
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.clpsych-1.15/
- DOI:
- Cite (ACL):
- Vassilis Lyberatos, Edmund Dervakos, Eleni Adamidi, Athanasios Voulodimos, and Giorgos Stamou. 2026. Exploration of Perceptual Speech Features for Clinical Decision-Support in Mental Health Care. In Proceedings of the 10th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2026), pages 188–207, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- Exploration of Perceptual Speech Features for Clinical Decision-Support in Mental Health Care (Lyberatos et al., CLPsych 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.clpsych-1.15.pdf