TONI-NLP at PsyDefDetect: Defense Mechanism Detection via LLM-based Ensemble Methods
Durjoy Paul, Arshitha Basavaraj, Callum Chan, Veronica Perez-Rosas, Diana Inkpen, Francisco Pereira, Juan Antonio Lossio-Ventura
Abstract
This system paper presents the approach of Team TONI-NLP to the PsyDefDetect 2026 shared task. The objective of the task was to classify utterances from helper–seeker conversations into nine categories: seven labels representing progressively higher levels of defensive maturity, one label indicating the absence of a defense mechanism, and one label for cases requiring additional information. We investigated several modern NLP approaches, including prompt engineering, fine-tuning, hierarchical modeling and classification using text embeddings derived from transformer-based models as well as classical embeddings such as TF-IDF. Our results show that ensemble methods performed best among our submitted systems, achieving a macro-F1 score of 0.320 and ranking 9th in the shared task out of 21 teams.- Anthology ID:
- 2026.bionlp-2.19
- Volume:
- Proceedings of the BioNLP 2026 (Shared Tasks)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Deepak Gupta, Dina Demner-Fushman
- Venues:
- BioNLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 132–140
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.19/
- DOI:
- Cite (ACL):
- Durjoy Paul, Arshitha Basavaraj, Callum Chan, Veronica Perez-Rosas, Diana Inkpen, Francisco Pereira, and Juan Antonio Lossio-Ventura. 2026. TONI-NLP at PsyDefDetect: Defense Mechanism Detection via LLM-based Ensemble Methods. In Proceedings of the BioNLP 2026 (Shared Tasks), pages 132–140, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- TONI-NLP at PsyDefDetect: Defense Mechanism Detection via LLM-based Ensemble Methods (Paul et al., BioNLP 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.bionlp-2.19.pdf