Detecting Winning Arguments with Large Language Models and Persuasion Strategies

Tiziano Labruna, Arkadiusz Modzelewski, Giorgio Satta, Giovanni Da San Martino


Abstract
Detecting persuasion in argumentative text is a challenging task with important implications for understanding human communication. This work investigates the role of persuasion strategies - such as Attack on reputation, Distraction, and Manipulative wording - in determining the persuasiveness of a text. We conduct experiments on three annotated argument datasets: Winning Arguments (built from the Change My View subreddit), Anthropic/Persuasion, and Persuasion for Good. Our approach leverages large language models (LLMs) with a chain-of-thought framework that guides reasoning over six persuasion strategies. Results show that strategy-guided reasoning improves the prediction of persuasiveness. To better understand the influence of content, we organize the Winning Argument dataset into broad discussion topics and analyze performance across them. We publicly release this topic-annotated version of the dataset to facilitate future research. Overall, our methodology demonstrates the value of structured, strategy-aware prompting for enhancing interpretability and robustness in argument quality assessment.
Anthology ID:
2026.findings-eacl.97
Volume:
Findings of the Association for Computational Linguistics: EACL 2026
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1888–1915
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.findings-eacl.97/
DOI:
Bibkey:
Cite (ACL):
Tiziano Labruna, Arkadiusz Modzelewski, Giorgio Satta, and Giovanni Da San Martino. 2026. Detecting Winning Arguments with Large Language Models and Persuasion Strategies. In Findings of the Association for Computational Linguistics: EACL 2026, pages 1888–1915, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
Detecting Winning Arguments with Large Language Models and Persuasion Strategies (Labruna et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.findings-eacl.97.pdf
Checklist:
 2026.findings-eacl.97.checklist.pdf