ShortCheck: Checkworthiness Detection of Multilingual Short‐Form Videos

Henrik Vatndal, Vinay Setty


Abstract
Short-form video platforms like TikTok present unique challenges for misinformation detection due to their multimodal, dynamic, and noisy content. We present ShortCheck, a modular, inference-only pipeline with a user-friendly pipeline that automatically identifies checkworthy short-form videos to help human fact-checkers. The system integrates speech transcription, OCR, object and deepfake detection, video-to-text summarization, and claim verification. ShortCheck is validated by evaluating it on two manually annotated datasets with TikTok videos in a multilingual setting. The pipeline achieves promising results with F1-weighted score over 70%. The demo can be accessed live at http://shortcheck.factiverse.ai.
Anthology ID:
2025.ijcnlp-demo.9
Volume:
Proceedings of The 14th International Joint Conference on Natural Language Processing and The 4th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics: System Demonstrations
Month:
December
Year:
2025
Address:
Mumbai, India
Editors:
Xuebo Liu, Ayu Purwarianti
Venue:
IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
77–85
Language:
URL:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.ijcnlp-demo.9/
DOI:
Bibkey:
Cite (ACL):
Henrik Vatndal and Vinay Setty. 2025. ShortCheck: Checkworthiness Detection of Multilingual Short‐Form Videos. In Proceedings of The 14th International Joint Conference on Natural Language Processing and The 4th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics: System Demonstrations, pages 77–85, Mumbai, India. Association for Computational Linguistics.
Cite (Informal):
ShortCheck: Checkworthiness Detection of Multilingual Short‐Form Videos (Vatndal & Setty, IJCNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.ijcnlp-demo.9.pdf