KinyaProp: Fine-Grained Propaganda Annotation in Kinyarwanda

Manzi Fabrice Niyigaba, Ivory Yang, Soroush Vosoughi


Abstract
Propaganda is a widely used approach for shaping public opinion and disseminating misinformation in news media. While it has recently gained significant attention within the NLP community, research on fine grained propaganda detection remains heavily concentrated in high resource languages. To bridge this gap, we introduce KinyaProp, the first fine-grained propaganda dataset of its kind for Kinyarwanda and, to our knowledge, the first such resource created for a Bantu language. Using this dataset, we evaluate whether state-of-the-art LLMs can function as reliable annotators in a genuinely low resource and culturally grounded setting. Our results show that current multilingual LLMs do not reliably approximate human annotation behavior. Instead, they behave as conservative annotators whose performance is largely limited to lexically explicit cues, substantially under-identifying propaganda and exhibiting extremely low and unstable performance on discourse-level techniques. Our findings highlight an important limitation of recent successes in LLM based annotation reported for high resource languages, demonstrating that such results do not readily transfer to low resource settings, where scalable annotation would be most valuable. We release KinyaProp to support future research on fine grained propaganda detection and to enable more robust evaluation of multilingual models in underrepresented languages.
Anthology ID:
2026.acl-long.1580
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
34230–34243
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1580/
DOI:
Bibkey:
Cite (ACL):
Manzi Fabrice Niyigaba, Ivory Yang, and Soroush Vosoughi. 2026. KinyaProp: Fine-Grained Propaganda Annotation in Kinyarwanda. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 34230–34243, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
KinyaProp: Fine-Grained Propaganda Annotation in Kinyarwanda (Niyigaba et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1580.pdf
Checklist:
 2026.acl-long.1580.checklist.pdf