CAT: Credibility Analysis of Arabic Content on Twitter

Rim El Ballouli, Wassim El-Hajj, Ahmad Ghandour, Shady Elbassuoni, Hazem Hajj, Khaled Shaban


Abstract
Data generated on Twitter has become a rich source for various data mining tasks. Those data analysis tasks that are dependent on the tweet semantics, such as sentiment analysis, emotion mining, and rumor detection among others, suffer considerably if the tweet is not credible, not real, or spam. In this paper, we perform an extensive analysis on credibility of Arabic content on Twitter. We also build a classification model (CAT) to automatically predict the credibility of a given Arabic tweet. Of particular originality is the inclusion of features extracted directly or indirectly from the author’s profile and timeline. To train and test CAT, we annotated for credibility a data set of 9,000 Arabic tweets that are topic independent. CAT achieved consistent improvements in predicting the credibility of the tweets when compared to several baselines and when compared to the state-of-the-art approach with an improvement of 21% in weighted average F-measure. We also conducted experiments to highlight the importance of the user-based features as opposed to the content-based features. We conclude our work with a feature reduction experiment that highlights the best indicative features of credibility.
Anthology ID:
W17-1308
Volume:
Proceedings of the Third Arabic Natural Language Processing Workshop
Month:
April
Year:
2017
Address:
Valencia, Spain
Venue:
WANLP
SIG:
SEMITIC
Publisher:
Association for Computational Linguistics
Note:
Pages:
62–71
Language:
URL:
https://aclanthology.org/W17-1308
DOI:
10.18653/v1/W17-1308
Bibkey:
Cite (ACL):
Rim El Ballouli, Wassim El-Hajj, Ahmad Ghandour, Shady Elbassuoni, Hazem Hajj, and Khaled Shaban. 2017. CAT: Credibility Analysis of Arabic Content on Twitter. In Proceedings of the Third Arabic Natural Language Processing Workshop, pages 62–71, Valencia, Spain. Association for Computational Linguistics.
Cite (Informal):
CAT: Credibility Analysis of Arabic Content on Twitter (El Ballouli et al., WANLP 2017)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/W17-1308.pdf