IRNLP at SemEval-2025 Task 10: Multilingual Narrative Characterization and Classification

Panagiotis Kiousis


Abstract
Our system approach for multilingual narrative classification is basically based on XLM-RoBERTa Large and other bert-based models(e.g DeepPavlov, Neuralmind BERT), fine-tuned on different language datasets. To improve generalization and ensure robust performance across languages, we employed a repeated k-fold cross-validation strategy. This allowed us to maximize the use of available training data while mitigating potential overfitting issues. Our preprocessing pipeline included (1) language-specific tokenization, (2) hierarchical label structuring, and (3) dynamic batch sampling to balance label distributions. We optimized the model using the F1 macro and F1 samples metrics ,ensuring that the system’s predictions were well-calibrated for fine-grained multilingual classification. The results demonstrated that our approach effectively leveraged transformer-based architectures to model complex narrative structures across languages, with strong performance gains due to repeated k-fold evaluation.
Anthology ID:
2025.semeval-1.9
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
54–57
Language:
URL:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.9/
DOI:
Bibkey:
Cite (ACL):
Panagiotis Kiousis. 2025. IRNLP at SemEval-2025 Task 10: Multilingual Narrative Characterization and Classification. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 54–57, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
IRNLP at SemEval-2025 Task 10: Multilingual Narrative Characterization and Classification (Kiousis, SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2025-08/2025.semeval-1.9.pdf