KCL-Cogstack at PsyDefDetect: A Hierarchical Approach to Detecting Defense Mechanisms in Supportive Dialogue

Shubham Agarwal, Thomas Searle, Richard Dobson


Abstract
We present our system for the PsyDefDetect shared task, which focuses on detecting and classifying psychological defense mechanisms in peer emotional support conversations. Our core contribution is a hierarchical classification framework that structures prediction as a coarse-to-fine pipeline over a clinically validated label hierarchy, grounded in the Defense Mechanism Rating Scales (DMRS). Through systematic experimentation with flat fine-tuning, few-shot prompting, and hierarchical classification, we demonstrate that explicitly modelling the structured relationships among defense levels offers a more effective alternative to flat classification, achieving a macro F1 of 0.23 on the official test set.
Anthology ID:
2026.bionlp-2.22
Volume:
Proceedings of the BioNLP 2026 (Shared Tasks)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Deepak Gupta, Dina Demner-Fushman
Venues:
BioNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
155–163
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.22/
DOI:
Bibkey:
Cite (ACL):
Shubham Agarwal, Thomas Searle, and Richard Dobson. 2026. KCL-Cogstack at PsyDefDetect: A Hierarchical Approach to Detecting Defense Mechanisms in Supportive Dialogue. In Proceedings of the BioNLP 2026 (Shared Tasks), pages 155–163, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
KCL-Cogstack at PsyDefDetect: A Hierarchical Approach to Detecting Defense Mechanisms in Supportive Dialogue (Agarwal et al., BioNLP 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.22.pdf
Supplementarymaterial:
 2026.bionlp-2.22.SupplementaryMaterial.txt