Abstract
Diverging from the trend of the previous rumor verification studies, we introduce the new task of rumor verification using evidence that are exclusively captured from authorities, i.e., entities holding the right and knowledge to verify corresponding information. To enable research on this task for Arabic low-resourced language, we construct and release the first Authority-Rumor-Evidence Dataset (AuRED). The dataset comprises 160 rumors expressed in tweets and 692 Twitter timelines of authorities containing about 34k tweets. Additionally, we explore how existing evidence retrieval and claim verification models for fact-checking perform on our task under both the cross-lingual zero-shot and in-domain fine-tuning setups. Our experiments show that although evidence retrieval models perform relatively well on the task establishing strong baselines, there is still a big room for improvement. However, existing claim verification models perform poorly on the task no matter how good the retrieval performance is. The results also show that stance detection can be useful for evidence retrieval. Moreover, existing fact-checking datasets showed a potential in transfer learning to our task, however, further investigation using different datasets and setups is required.- Anthology ID:
- 2024.arabicnlp-1.3
- Volume:
- Proceedings of The Second Arabic Natural Language Processing Conference
- Month:
- August
- Year:
- 2024
- Address:
- Bangkok, Thailand
- Editors:
- Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, Khalil Mrini
- Venues:
- ArabicNLP | WS
- SIG:
- SIGARAB
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 27–41
- Language:
- URL:
- https://aclanthology.org/2024.arabicnlp-1.3
- DOI:
- 10.18653/v1/2024.arabicnlp-1.3
- Cite (ACL):
- Fatima Haouari, Tamer Elsayed, and Reem Suwaileh. 2024. AuRED: Enabling Arabic Rumor Verification using Evidence from Authorities over Twitter. In Proceedings of The Second Arabic Natural Language Processing Conference, pages 27–41, Bangkok, Thailand. Association for Computational Linguistics.
- Cite (Informal):
- AuRED: Enabling Arabic Rumor Verification using Evidence from Authorities over Twitter (Haouari et al., ArabicNLP-WS 2024)
- PDF:
- https://preview.aclanthology.org/autopr/2024.arabicnlp-1.3.pdf