Beyond Fake News Detection: A Community-based Study of the Multicultural Nature of Information Disorder
Sara Gemelli, Giulia Di Cristina, Yiran Zhang, Md Azizul Hoque, Alberto De La Torre Solís, Mohamad Mojtaba Behboudi Eshkiki, Nikolai Efimov, Mariia Everstova, Caterina Maria Cappello, Maziar Kianimoghadam Jouneghani, Payam Latifi, Yashar Mahboudi, Farzaneh Mohseni, Dario Placenti, Tommaso Caselli, Manuela Sanguinetti, Aurora Scarpellini, Chiara Zanchi, Usman Naseem, Marco Antonio Stranisci, Simona Frenda
Abstract
Recognizing disinformation is a challenging task for humans and AI systems. News can be false, misleading, or harmful, and its interpretation often depends on the cultural context of the audience. However, existing datasets rarely account for these contextual and cultural differences, as they are typically not designed from the perspective of news consumers. To address this gap, in this paper, we present the Information Disorder (InDor) corpus, a multilingual dataset of news articles in English, Farsi, Italian, and Russian, annotated for information disorder detection and explanation. The corpus was developed through a participatory process involving contributors from diverse cultural and professional backgrounds, who engaged in data collection, annotation, and evaluation of Large Language Model (LLM) performance on the task. Our findings highlight that false and manipulated news manifest differently across cultural settings, and that current LLMs fail to adequately capture this complexity. This underscores the need for culturally aware computational approaches in the study of information disorder.- Anthology ID:
- 2026.lrec-1.515
- Volume:
- Proceedings of the Fifteenth Language Resources and Evaluation Conference
- Month:
- May
- Year:
- 2026
- Address:
- Palma de Mallorca, Spain
- Editors:
- Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
- Venue:
- LREC
- SIG:
- Publisher:
- ELRA Language Resource Association
- Note:
- Pages:
- 6496–6508
- Language:
- External URL:
- https://lrec.elra.info/lrec2026-main-515
- DOI:
- 10.63317/4iyhqziwo6ri
- Cite (ACL):
- Sara Gemelli, Giulia Di Cristina, Yiran Zhang, Md Azizul Hoque, Alberto De La Torre Solís, Mohamad Mojtaba Behboudi Eshkiki, Nikolai Efimov, Mariia Everstova, Caterina Maria Cappello, Maziar Kianimoghadam Jouneghani, Payam Latifi, Yashar Mahboudi, Farzaneh Mohseni, Dario Placenti, Tommaso Caselli, Manuela Sanguinetti, Aurora Scarpellini, Chiara Zanchi, Usman Naseem, Marco Antonio Stranisci, and Simona Frenda. 2026. Beyond Fake News Detection: A Community-based Study of the Multicultural Nature of Information Disorder. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 6496–6508, Palma de Mallorca, Spain. ELRA Language Resource Association.
- Cite (Informal):
- Beyond Fake News Detection: A Community-based Study of the Multicultural Nature of Information Disorder (Gemelli et al., LREC 2026)