Propaganda Signals in LLMs: Perspectival Divergence and Narrative Framing in the Russia-Ukraine War

Ofir Shabat, Ido Guy, Kira Radinsky


Abstract
Large Language Models (LLMs) are increasingly used to explain, summarize, and translate real-world events, including ongoing geopolitical conflicts. Yet it remains unclear whether they reproduce conflict-specific propaganda and, if so, how this appears in their outputs. We study this question for the Russia-Ukraine war through perspectival divergence, the extent to which model outputs align with competing narratives from different information ecosystems. We construct a conflict-aware evaluation set of neutral English event statements paired with Russian (RU)- and Ukrainian (UA)-oriented reference texts drawn from news outlets and Telegram channels. We then evaluate multiple LLMs under several prompting contexts using a reference-based semantic distance metric that measures directional proximity to RU- and UA-oriented references. To explain not only which side a model is closer to but also how that alignment is expressed, we further analyze outputs using five propaganda-relevant categories: Framing Narrative, Emotional Manipulation, Source Credibility, Social Pressure Identity, and Toponymy Naming. Across models, we find stable, model-specific leanings and technique profiles that persist across prompts and are not captured by standard factuality-oriented metrics. Our findings show that models that appear neutral under conventional evaluations can still encode systematic, conflict-specific propaganda patterns, underscoring the need for conflict-aware evaluation frameworks.
Anthology ID:
2026.findings-acl.557
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11484–11501
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.557/
DOI:
Bibkey:
Cite (ACL):
Ofir Shabat, Ido Guy, and Kira Radinsky. 2026. Propaganda Signals in LLMs: Perspectival Divergence and Narrative Framing in the Russia-Ukraine War. In Findings of the Association for Computational Linguistics: ACL 2026, pages 11484–11501, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Propaganda Signals in LLMs: Perspectival Divergence and Narrative Framing in the Russia-Ukraine War (Shabat et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.557.pdf
Checklist:
 2026.findings-acl.557.checklist.pdf