Localization of Fake News Detection via Multitask Transfer Learning
Jan Christian Blaise Cruz, Julianne Agatha Tan, Charibeth Cheng
Abstract
The use of the internet as a fast medium of spreading fake news reinforces the need for computational tools that combat it. Techniques that train fake news classifiers exist, but they all assume an abundance of resources including large labeled datasets and expert-curated corpora, which low-resource languages may not have. In this work, we make two main contributions: First, we alleviate resource scarcity by constructing the first expertly-curated benchmark dataset for fake news detection in Filipino, which we call “Fake News Filipino.” Second, we benchmark Transfer Learning (TL) techniques and show that they can be used to train robust fake news classifiers from little data, achieving 91% accuracy on our fake news dataset, reducing the error by 14% compared to established few-shot baselines. Furthermore, lifting ideas from multitask learning, we show that augmenting transformer-based transfer techniques with auxiliary language modeling losses improves their performance by adapting to writing style. Using this, we improve TL performance by 4-6%, achieving an accuracy of 96% on our best model. Lastly, we show that our method generalizes well to different types of news articles, including political news, entertainment news, and opinion articles.- Anthology ID:
- 2020.lrec-1.316
- Volume:
- Proceedings of the Twelfth Language Resources and Evaluation Conference
- Month:
- May
- Year:
- 2020
- Address:
- Marseille, France
- Editors:
- Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association
- Note:
- Pages:
- 2596–2604
- Language:
- English
- URL:
- https://aclanthology.org/2020.lrec-1.316
- DOI:
- Cite (ACL):
- Jan Christian Blaise Cruz, Julianne Agatha Tan, and Charibeth Cheng. 2020. Localization of Fake News Detection via Multitask Transfer Learning. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 2596–2604, Marseille, France. European Language Resources Association.
- Cite (Informal):
- Localization of Fake News Detection via Multitask Transfer Learning (Cruz et al., LREC 2020)
- PDF:
- https://preview.aclanthology.org/improve-issue-templates/2020.lrec-1.316.pdf
- Code
- jcblaisecruz02/Tagalog-fake-news
- Data
- Fake News Filipino Dataset, WikiText-TL-39