Narrative Navigators at FIGNEWS 2024 Shared Task: New Frontiers in Bias and Propaganda Annotation Techniques
Maryam AlEmadi, Jana ElMesselmani, Lyna Bermak, Goumana Abdullah, Esra’a Sharqawi, Anissa Jrad, Zied Zouabi, Wajdi Zaghouani
Abstract
This paper presents our team’s contribution to the FIGNEWS 2024 Shared Task, which involved annotating bias and propaganda in news coverage of the Israel-Palestine conflict. We developed comprehensive guidelines and employed a rigorous methodology to analyze 2,200 news posts from several official Facebook accounts of news websites in multiple languages. Our team, Narrative Navigators, achieved third place in both the Bias Guidelines and Bias Consistency tracks, demonstrating the effectiveness of our approach. We achieved an IAA Kappa score of 39.4 for bias annotation and 12.8 for propaganda detection. These findings and our performance underscore the need for enhanced media literacy and further research to counter the impact of biased and misleading information on public understanding of the conflict.- Anthology ID:
- 2024.arabicnlp-1.57
- Volume:
- Proceedings of The Second Arabic Natural Language Processing Conference
- Month:
- August
- Year:
- 2024
- Address:
- Bangkok, Thailand
- Editors:
- Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, Khalil Mrini
- Venues:
- ArabicNLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 548–554
- Language:
- URL:
- https://aclanthology.org/2024.arabicnlp-1.57
- DOI:
- 10.18653/v1/2024.arabicnlp-1.57
- Cite (ACL):
- Maryam AlEmadi, Jana ElMesselmani, Lyna Bermak, Goumana Abdullah, Esra’a Sharqawi, Anissa Jrad, Zied Zouabi, and Wajdi Zaghouani. 2024. Narrative Navigators at FIGNEWS 2024 Shared Task: New Frontiers in Bias and Propaganda Annotation Techniques. In Proceedings of The Second Arabic Natural Language Processing Conference, pages 548–554, Bangkok, Thailand. Association for Computational Linguistics.
- Cite (Informal):
- Narrative Navigators at FIGNEWS 2024 Shared Task: New Frontiers in Bias and Propaganda Annotation Techniques (AlEmadi et al., ArabicNLP-WS 2024)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-5/2024.arabicnlp-1.57.pdf