NITK-VITAL at SemEval-2025 Task 11: Focal-RoBERTa: Addressing Class Imbalance in Multi-Label Emotion Classification
Ashinee Kesanam, Gummuluri Venkata Ravi Ram, Chaithanya Swaroop Banoth, G Rama Mohana Reddy
Abstract
This paper presents our approach to SemEval Task 11, which focuses on multi-label emotion detection in English textual data. We experimented with multiple methodologies, including traditional machine learning models, deep learning architectures, and transformer-based models. Our best-performing approach employed RoBERTa with focal loss, which effectively mitigated class imbalances and achieved a macro F1-score of 0.7563, outperforming other techniques. Comparative analyses between different embedding strategies, such as TF-IDF, BERT, and MiniLM, revealed that transformer-based models consistently provided superior performance. The results demonstrate the effectiveness of focal loss in handling highly skewed emotion distributions. Our system contributes to advancing multi-label emotion detection by leveraging robust pre-trained models and loss function optimization.- Anthology ID:
- 2025.semeval-1.142
- Volume:
- Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
- Month:
- July
- Year:
- 2025
- Address:
- Vienna, Austria
- Editors:
- Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
- Venues:
- SemEval | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1077–1081
- Language:
- URL:
- https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.142/
- DOI:
- Cite (ACL):
- Ashinee Kesanam, Gummuluri Venkata Ravi Ram, Chaithanya Swaroop Banoth, and G Rama Mohana Reddy. 2025. NITK-VITAL at SemEval-2025 Task 11: Focal-RoBERTa: Addressing Class Imbalance in Multi-Label Emotion Classification. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 1077–1081, Vienna, Austria. Association for Computational Linguistics.
- Cite (Informal):
- NITK-VITAL at SemEval-2025 Task 11: Focal-RoBERTa: Addressing Class Imbalance in Multi-Label Emotion Classification (Kesanam et al., SemEval 2025)
- PDF:
- https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.142.pdf