Tamara Fuchs
2025
Narrlangen at SemEval-2025 Task 10: Comparing (mostly) simple multilingual approaches to narrative classification
Andreas Blombach
|
Bao Minh Doan Dang
|
Stephanie Evert
|
Tamara Fuchs
|
Philipp Heinrich
|
Olena Kalashnikova
|
Naveed Unjum
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Our team focused on Subtask 2 (narrative classification) and tried several conceptually straightforward approaches: (1) prompt engineering of LLMs, (2) a zero-shot approach based on sentence similarities, (3) direct classification of fine-grained labels using SetFit, (4) fine-tuning encoder models on fine-grained labels, and (5) hierarchical classification using encoder models with two different classification heads. We list results for all systems on the development set, which show that the best approach was to fine-tune a pre-trained multilingual model, XLM-RoBERTa, with two additional linear layers and a softmax as classification head.
Search
Fix author
Co-authors
- Andreas Blombach 1
- Bao Minh Doan Dang 1
- Stephanie Evert 1
- Philipp Heinrich 1
- Olena Kalashnikova 1
- show all...