Discriminant Validity: Disentangling Health and Emotional Constructs from Language-Based Assessments
Scott Feltman, Adithya V Ganesan, Whitney Ringwald, H. Andrew Schwartz, Roman Kotov, Benjamin Luft, Ryan Boyd, Oscar Kjell
Abstract
Language-based assessments have demonstrated high convergent validity with corresponding mental and physical health constructs, however often fail to address discriminant validity - the measure’s ability to distinguish the target construct from related ones. This is a common phenomenon within the domain of mental health, as well as comorbidity with physical health conditions. Identifying key features of individual dimensions of mental and physical health present in language can unlock new avenues of research for natural language processing and psychology. We propose two augmentations to the objective function of the Ridge model, deriving closed-form solutions compatible with Singular Value Decomposition-based solvers, to enforce discriminant validity of off-target constructs using Mean Squared Error (MSE) and Squared Cosine Similarity (SCS,) both having widespread use in contrastive learning. By varying the discrimination strength, we find that a decrease in 0.005 Pearson correlation points can result in a Pearson correlation point increase upwards of 0.132 in discriminant validity for mental and physical health constructs derived from self-reported questionnaires. We see similar improvements across multiple fundamental psychopathology dimensions simultaneously, increasing discriminant validity by 0.012 with stronger increases coming from more noisy, less reliable constructs. Our contributions provide a theoretically grounded path towards improving confidence in language-based assessments in the clinical sector, improving specificity of said assessments to various areas of health.- Anthology ID:
- 2026.clpsych-1.4
- Volume:
- Proceedings of the 10th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Aya Zirikly, Kfir Bar, Sean MacAvaney, Molly Ireland, Yaakov Ophir, Dana Atzil-Slonim, Vasudha Varadarajan, Steven Bedrick, Bart Desmet
- Venues:
- CLPsych | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 43–55
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.clpsych-1.4/
- DOI:
- Cite (ACL):
- Scott Feltman, Adithya V Ganesan, Whitney Ringwald, H. Andrew Schwartz, Roman Kotov, Benjamin Luft, Ryan Boyd, and Oscar Kjell. 2026. Discriminant Validity: Disentangling Health and Emotional Constructs from Language-Based Assessments. In Proceedings of the 10th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2026), pages 43–55, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- Discriminant Validity: Disentangling Health and Emotional Constructs from Language-Based Assessments (Feltman et al., CLPsych 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.clpsych-1.4.pdf