University of Indonesia at SemEval-2025 Task 11: Evaluating State-of-the-Art Encoders for Multi-Label Emotion Detection

Ikhlasul Hanif, Eryawan Presma Yulianrifat, Jaycent Ongris, Eduardus Tjitrahardja, Muhammad Azmi, Rahmat Naufal, Alfan Wicaksono


Abstract
This paper presents our approach for SemEval 2025 Task 11 Track A, focusing on multilabel emotion classification across 28 languages. We explore two main strategies: fully fine-tuning transformer models and classifier-only training, evaluating different settings such as fine-tuning strategies, model architectures, loss functions, encoders, and classifiers. Our findings suggest that training a classifier on top of prompt-based encoders such as mE5 and BGE yields significantly better results than fully fine-tuning XLMR and mBERT. Our best-performing model on the final leaderboard is an ensemble combining multiple BGE models, where CatBoost serves as the classifier, with different configurations. This ensemble achieves an average F1-macro score of 56.58 across all languages.
Anthology ID:
2025.semeval-1.279
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2149–2164
Language:
URL:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.279/
DOI:
Bibkey:
Cite (ACL):
Ikhlasul Hanif, Eryawan Presma Yulianrifat, Jaycent Ongris, Eduardus Tjitrahardja, Muhammad Azmi, Rahmat Naufal, and Alfan Wicaksono. 2025. University of Indonesia at SemEval-2025 Task 11: Evaluating State-of-the-Art Encoders for Multi-Label Emotion Detection. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 2149–2164, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
University of Indonesia at SemEval-2025 Task 11: Evaluating State-of-the-Art Encoders for Multi-Label Emotion Detection (Hanif et al., SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.279.pdf