How Much Does Persuasion Strategy Matter? LLM-Annotated Evidence from Charitable Donation Dialogues

Tatiana Petrova, Stanislav Sokol, Radu State


Abstract
Which persuasion strategies, if any, are associated with donation compliance? Answering this requires fine-grained strategy labels across a full corpus and statistical tests corrected for multiple comparisons. We annotate all 10,600 persuader turns in the 1,017-dialogue PersuasionForGood corpus with a taxonomy of 41 strategies in 11 categories, using three open-source large language models (Qwen3:30b, Mistral-Small-3.2, Phi-4). Strategy categories alone explain little variance in donation outcome (pseudo R-squared approximately 0.015, consistent across all three annotators). Guilt Induction is the only strategy significantly associated with lower donation rates (approximately -23 percentage points), an effect that replicates across all three models despite only moderate inter-model agreement. Reciprocity is the most robust positive correlate. Target sentiment and interest predict whether a donation occurs but show at most a weak correlation with donation amount. Logistic regression with sentiment, interest, Guilt Induction, and Reciprocity achieves nearly the same fit (pseudo R-squared = 0.080) as the full model with all strategy categories. These findings suggest that strategy identification alone is insufficient to explain persuasion effectiveness, and that guilt-based appeals may be counterproductive in prosocial settings. We release the fully annotated corpus as a public resource.
Anthology ID:
2026.socon-1.5
Volume:
Proceedings of the 1st Workshop on Social Context (SoCon) and the 2nd Workshop on Integrating NLP and Psychology to Study Social Interactions (NLPSI) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Marco Antonio Stranisci, Neele Falk, Sofie Labat, Soda Marem Lo, Aswathy Velutharambath, Sabine Weber, Rossana Damiano, Simona Frenda, Veronique Hoste, Bennett Kleinberg, Roman Klinger, Viviana Patti, Flor Miriam Plaza-del-Arco, Maarten Sap, Seid Muhie Yimam
Venues:
SoCon | NLPSI | WS
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
40–47
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-soconnlpsi-05
DOI:
10.63317/4hquav3a9b4n
Bibkey:
Cite (ACL):
Tatiana Petrova, Stanislav Sokol, and Radu State. 2026. How Much Does Persuasion Strategy Matter? LLM-Annotated Evidence from Charitable Donation Dialogues. In Proceedings of the 1st Workshop on Social Context (SoCon) and the 2nd Workshop on Integrating NLP and Psychology to Study Social Interactions (NLPSI) @ LREC 2026, pages 40–47, Palma, Mallorca (Spain). European Language Resources Association (ELRA).
Cite (Informal):
How Much Does Persuasion Strategy Matter? LLM-Annotated Evidence from Charitable Donation Dialogues (Petrova et al., SoCon-NLPSI 2026)
Copy Citation: