Arshitha Basavaraj
2026
TONI-NLP at PsyDefDetect: Defense Mechanism Detection via LLM-based Ensemble Methods
Durjoy Paul | Arshitha Basavaraj | Callum Chan | Veronica Perez-Rosas | Diana Inkpen | Francisco Pereira | Juan Antonio Lossio-Ventura
Proceedings of the BioNLP 2026 (Shared Tasks)
Durjoy Paul | Arshitha Basavaraj | Callum Chan | Veronica Perez-Rosas | Diana Inkpen | Francisco Pereira | Juan Antonio Lossio-Ventura
Proceedings of the BioNLP 2026 (Shared Tasks)
This system paper presents the approach of Team TONI-NLP to the PsyDefDetect 2026 shared task. The objective of the task was to classify utterances from helper–seeker conversations into nine categories: seven labels representing progressively higher levels of defensive maturity, one label indicating the absence of a defense mechanism, and one label for cases requiring additional information. We investigated several modern NLP approaches, including prompt engineering, fine-tuning, hierarchical modeling and classification using text embeddings derived from transformer-based models as well as classical embeddings such as TF-IDF. Our results show that ensemble methods performed best among our submitted systems, achieving a macro-F1 score of 0.320 and ranking 9th in the shared task out of 21 teams.