Ethical thematic and topic modelling analysis of sleep concerns in a social media derived suicidality dataset

Martin Orr, Kirsten Van Kessel, David Parry


Abstract
Objective: A thematic and topic modelling analysis of sleep concerns in a social media derived, privacy-preserving, suicidality dataset. This forms the basis for an exploration of sleep as a potential computational linguistic signal in suicide prevention. Background: Suicidal ideation is a limited signal for suicide. Developments in computational linguistics and mental health datasets afford an opportunity to investigate additional signals and to consider the broader clinical ethical design implications. Methodology: A clinician-led integration of reflexive thematic analysis, with machine learning topic modelling (Bertopic), and the purposeful sampling of the University of Maryland Suicidality Dataset. Results: Sleep as a place of refuge and escape, revitalisation for exhaustion, and risk and vulnerability were generated as core themes in an initial thematic analysis of 546 posts. Bertopic analysing 21,876 sleep references in 16791 posts facilitated the production of 40 topics that were clinically interpretable, relevant, and thematically aligned to a level that exceeded original expectations. Privacy and synthetic representative data, reproducibility, validity and stochastic variability of results, and a multi-signal formulation perspective, are highlighted as key research and clinical issues.
Anthology ID:
2024.clpsych-1.6
Volume:
Proceedings of the 9th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2024)
Month:
March
Year:
2024
Address:
St. Julians, Malta
Editors:
Andrew Yates, Bart Desmet, Emily Prud’hommeaux, Ayah Zirikly, Steven Bedrick, Sean MacAvaney, Kfir Bar, Molly Ireland, Yaakov Ophir
Venues:
CLPsych | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
74–91
Language:
URL:
https://aclanthology.org/2024.clpsych-1.6
DOI:
Bibkey:
Cite (ACL):
Martin Orr, Kirsten Van Kessel, and David Parry. 2024. Ethical thematic and topic modelling analysis of sleep concerns in a social media derived suicidality dataset. In Proceedings of the 9th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2024), pages 74–91, St. Julians, Malta. Association for Computational Linguistics.
Cite (Informal):
Ethical thematic and topic modelling analysis of sleep concerns in a social media derived suicidality dataset (Orr et al., CLPsych-WS 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-3/2024.clpsych-1.6.pdf
Video:
 https://preview.aclanthology.org/nschneid-patch-3/2024.clpsych-1.6.mp4