Joint Rumour Stance and Veracity Prediction
Anders Edelbo Lillie, Emil Refsgaard Middelboe, Leon Derczynski
Abstract
The net is rife with rumours that spread through microblogs and social media. Not all the claims in these can be verified. However, recent work has shown that the stances alone that commenters take toward claims can be sufficiently good indicators of claim veracity, using e.g. an HMM that takes conversational stance sequences as the only input. Existing results are monolingual (English) and mono-platform (Twitter). This paper introduces a stance-annotated Reddit dataset for the Danish language, and describes various implementations of stance classification models. Of these, a Linear SVM provides predicts stance best, with 0.76 accuracy / 0.42 macro F1. Stance labels are then used to predict veracity across platforms and also across languages, training on conversations held in one language and using the model on conversations held in another. In our experiments, monolinugal scores reach stance-based veracity accuracy of 0.83 (F1 0.68); applying the model across languages predicts veracity of claims with an accuracy of 0.82 (F1 0.67). This demonstrates the surprising and powerful viability of transferring stance-based veracity prediction across languages.- Anthology ID:
- W19-6122
- Volume:
- Proceedings of the 22nd Nordic Conference on Computational Linguistics
- Month:
- September–October
- Year:
- 2019
- Address:
- Turku, Finland
- Editors:
- Mareike Hartmann, Barbara Plank
- Venue:
- NoDaLiDa
- SIG:
- Publisher:
- Linköping University Electronic Press
- Note:
- Pages:
- 208–221
- Language:
- URL:
- https://aclanthology.org/W19-6122
- DOI:
- Cite (ACL):
- Anders Edelbo Lillie, Emil Refsgaard Middelboe, and Leon Derczynski. 2019. Joint Rumour Stance and Veracity Prediction. In Proceedings of the 22nd Nordic Conference on Computational Linguistics, pages 208–221, Turku, Finland. Linköping University Electronic Press.
- Cite (Informal):
- Joint Rumour Stance and Veracity Prediction (Lillie et al., NoDaLiDa 2019)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/W19-6122.pdf
- Code
- danish-stance-detectors/RumourResolution + additional community code
- Data
- DAST