TONI-NLP at PsyDefDetect: Defense Mechanism Detection via LLM-based Ensemble Methods

Durjoy Paul, Arshitha Basavaraj, Callum Chan, Veronica Perez-Rosas, Diana Inkpen, Francisco Pereira, Juan Antonio Lossio-Ventura


Abstract
This system paper presents the approach of Team TONI-NLP to the PsyDefDetect 2026 shared task. The objective of the task was to classify utterances from helper–seeker conversations into nine categories: seven labels representing progressively higher levels of defensive maturity, one label indicating the absence of a defense mechanism, and one label for cases requiring additional information. We investigated several modern NLP approaches, including prompt engineering, fine-tuning, hierarchical modeling and classification using text embeddings derived from transformer-based models as well as classical embeddings such as TF-IDF. Our results show that ensemble methods performed best among our submitted systems, achieving a macro-F1 score of 0.320 and ranking 9th in the shared task out of 21 teams.
Anthology ID:
2026.bionlp-2.19
Volume:
Proceedings of the BioNLP 2026 (Shared Tasks)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Deepak Gupta, Dina Demner-Fushman
Venues:
BioNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
132–140
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.19/
DOI:
Bibkey:
Cite (ACL):
Durjoy Paul, Arshitha Basavaraj, Callum Chan, Veronica Perez-Rosas, Diana Inkpen, Francisco Pereira, and Juan Antonio Lossio-Ventura. 2026. TONI-NLP at PsyDefDetect: Defense Mechanism Detection via LLM-based Ensemble Methods. In Proceedings of the BioNLP 2026 (Shared Tasks), pages 132–140, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
TONI-NLP at PsyDefDetect: Defense Mechanism Detection via LLM-based Ensemble Methods (Paul et al., BioNLP 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.19.pdf
Supplementarymaterial:
 2026.bionlp-2.19.SupplementaryMaterial.txt
Supplementarymaterial:
 2026.bionlp-2.19.SupplementaryMaterial.zip