Hierarchical Multi-Stage Modeling of Adaptive and Maladaptive Self-States in Social Media Timelines

Abir Naskar, Mike Conway


Abstract
We address the CLPsych 2026 Shared Task on modeling psychological self-states from longitudinal social media data. We propose (i) a hierarchical multi-stage framework that integrates a multi-task transformer encoder and (ii) a four stage instruction-tuned large language model finetuning pipeline for subelement classification, presence estimation, and evidence extraction. Our approach incorporates element-conditioned label masking and cross-stage encoder transfer, enabling structured prediction aligned with the ABCD psychological framework. Experiments show improvements over the baseline on the development setup, with RoBERTa achieving an 8.3\% gain in macro-F1 and improved RMSE, while a fine-tuned Qwen3 model attains the best overall performance. These results demonstrate the effectiveness of combining hierarchical multi-task learning with structured generation for interpretable mental health analysis.
Anthology ID:
2026.clpsych-1.37
Volume:
Proceedings of the 10th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Aya Zirikly, Kfir Bar, Sean MacAvaney, Molly Ireland, Yaakov Ophir, Dana Atzil-Slonim, Vasudha Varadarajan, Steven Bedrick, Bart Desmet
Venues:
CLPsych | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
472–481
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.clpsych-1.37/
DOI:
Bibkey:
Cite (ACL):
Abir Naskar and Mike Conway. 2026. Hierarchical Multi-Stage Modeling of Adaptive and Maladaptive Self-States in Social Media Timelines. In Proceedings of the 10th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2026), pages 472–481, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Hierarchical Multi-Stage Modeling of Adaptive and Maladaptive Self-States in Social Media Timelines (Naskar & Conway, CLPsych 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.clpsych-1.37.pdf