NITK-VITAL at SemEval-2025 Task 11: Focal-RoBERTa: Addressing Class Imbalance in Multi-Label Emotion Classification

Ashinee Kesanam, Gummuluri Venkata Ravi Ram, Chaithanya Swaroop Banoth, G Rama Mohana Reddy


Abstract
This paper presents our approach to SemEval Task 11, which focuses on multi-label emotion detection in English textual data. We experimented with multiple methodologies, including traditional machine learning models, deep learning architectures, and transformer-based models. Our best-performing approach employed RoBERTa with focal loss, which effectively mitigated class imbalances and achieved a macro F1-score of 0.7563, outperforming other techniques. Comparative analyses between different embedding strategies, such as TF-IDF, BERT, and MiniLM, revealed that transformer-based models consistently provided superior performance. The results demonstrate the effectiveness of focal loss in handling highly skewed emotion distributions. Our system contributes to advancing multi-label emotion detection by leveraging robust pre-trained models and loss function optimization.
Anthology ID:
2025.semeval-1.142
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1077–1081
Language:
URL:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.142/
DOI:
Bibkey:
Cite (ACL):
Ashinee Kesanam, Gummuluri Venkata Ravi Ram, Chaithanya Swaroop Banoth, and G Rama Mohana Reddy. 2025. NITK-VITAL at SemEval-2025 Task 11: Focal-RoBERTa: Addressing Class Imbalance in Multi-Label Emotion Classification. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 1077–1081, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
NITK-VITAL at SemEval-2025 Task 11: Focal-RoBERTa: Addressing Class Imbalance in Multi-Label Emotion Classification (Kesanam et al., SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.142.pdf