The UNLP 2025 Shared Task on Detecting Social Media Manipulation

Roman Kyslyi, Nataliia Romanyshyn, Volodymyr Sydorskyi


Abstract
This paper presents the results of the UNLP 2025 Shared Task on Detecting Social Media Manipulation. The task included two tracks: Technique Classification and Span Identification. The benchmark dataset contains 9,557 posts from Ukrainian Telegram channels manually annotated by media experts. A total of 51 teams registered, 22 teams submitted systems, and 595 runs were evaluated on a hidden test set via Kaggle. Performance was measured with macro F1 for classification and token‐level F1 for identification. The shared task provides the first publicly available benchmark for manipulation detection in Ukrainian social media and highlights promising directions for low‐resource propaganda research. The Kaggle leaderboard is left open for further submissions.
Anthology ID:
2025.unlp-1.12
Volume:
Proceedings of the Fourth Ukrainian Natural Language Processing Workshop (UNLP 2025)
Month:
July
Year:
2025
Address:
Vienna, Austria (online)
Editor:
Mariana Romanyshyn
Venues:
UNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
105–111
Language:
URL:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.unlp-1.12/
DOI:
Bibkey:
Cite (ACL):
Roman Kyslyi, Nataliia Romanyshyn, and Volodymyr Sydorskyi. 2025. The UNLP 2025 Shared Task on Detecting Social Media Manipulation. In Proceedings of the Fourth Ukrainian Natural Language Processing Workshop (UNLP 2025), pages 105–111, Vienna, Austria (online). Association for Computational Linguistics.
Cite (Informal):
The UNLP 2025 Shared Task on Detecting Social Media Manipulation (Kyslyi et al., UNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.unlp-1.12.pdf