NLPColab at FigNews 2024 Shared Task: Challenges in Bias and Propaganda Annotation for News Media

Sadaf Abdul Rauf, Huda Sarfraz, Saadia Nauman, Arooj Fatima, SadafZiafat SadafZiafat, Momina Ishfaq, Alishba Suboor, Hammad Afzal, Seemab Latif

Abstract
In this paper, we present our methodology and findings from participating in the FIGNEWS 2024 shared task on annotating news fragments on the Gaza-Israel war for bias and propaganda detection. The task aimed to refine the FIGNEWS 2024 annotation guidelines and to contribute to the creation of a comprehensive dataset to advance research in this field. Our team employed a multi-faceted approach to ensure high accuracy in data annotations. Our results highlight key challenges in detecting bias and propaganda, such as the need for more comprehensive guidelines. Our team ranked first in all tracks for propaganda annotation. For Bias, the team stood in first place for the Guidelines and IAA tracks, and in second place for the Quantity and Consistency tracks.
Anthology ID:
2024.arabicnlp-1.61
Volume:
Proceedings of The Second Arabic Natural Language Processing Conference
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, Khalil Mrini
Venues:
ArabicNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
573–579
Language:
URL:
https://aclanthology.org/2024.arabicnlp-1.61
DOI:
10.18653/v1/2024.arabicnlp-1.61
Bibkey:
Cite (ACL):
Sadaf Abdul Rauf, Huda Sarfraz, Saadia Nauman, Arooj Fatima, SadafZiafat SadafZiafat, Momina Ishfaq, Alishba Suboor, Hammad Afzal, and Seemab Latif. 2024. NLPColab at FigNews 2024 Shared Task: Challenges in Bias and Propaganda Annotation for News Media. In Proceedings of The Second Arabic Natural Language Processing Conference, pages 573–579, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
NLPColab at FigNews 2024 Shared Task: Challenges in Bias and Propaganda Annotation for News Media (Abdul Rauf et al., ArabicNLP-WS 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-2024-clasp/2024.arabicnlp-1.61.pdf
PDF Search