DeMeVa at LeWiDi-2025: Modeling Perspectives with In-Context Learning and Label Distribution Learning
Daniil Ignatev, Nan Li, Hugh Mee Wong, Anh Dang, Shane Kaszefski Yaschuk
Abstract
This system paper presents the DeMeVa team’s approaches to the third edition of the Learning with Disagreements shared task (LeWiDi 2025; Leonardelli et al., 2025). We explore two directions: in-context learning (ICL) with large language models, where we compare example sampling strategies; and label distribution learning (LDL) methods with RoBERTa (Liu et al., 2019b), where we evaluate several fine-tuning methods. Our contributions are twofold: (1) we show that ICL can effectively predict annotator-specific annotations (perspectivist annotations), and that aggregating these predictions into soft labels yields competitive performance; and (2) we argue that LDL methods are promising for soft label predictions and merit further exploration by the perspectivist community.- Anthology ID:
- 2025.nlperspectives-1.15
- Volume:
- Proceedings of the The 4th Workshop on Perspectivist Approaches to NLP
- Month:
- November
- Year:
- 2025
- Address:
- Suzhou, China
- Editors:
- Gavin Abercrombie, Valerio Basile, Simona Frenda, Sara Tonelli, Shiran Dudy
- Venues:
- NLPerspectives | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 171–181
- Language:
- URL:
- https://preview.aclanthology.org/ingest-emnlp/2025.nlperspectives-1.15/
- DOI:
- Cite (ACL):
- Daniil Ignatev, Nan Li, Hugh Mee Wong, Anh Dang, and Shane Kaszefski Yaschuk. 2025. DeMeVa at LeWiDi-2025: Modeling Perspectives with In-Context Learning and Label Distribution Learning. In Proceedings of the The 4th Workshop on Perspectivist Approaches to NLP, pages 171–181, Suzhou, China. Association for Computational Linguistics.
- Cite (Informal):
- DeMeVa at LeWiDi-2025: Modeling Perspectives with In-Context Learning and Label Distribution Learning (Ignatev et al., NLPerspectives 2025)
- PDF:
- https://preview.aclanthology.org/ingest-emnlp/2025.nlperspectives-1.15.pdf