Beyond Logical Forms: LLM-Extracted Patterns for Fallacy Classification

Eleni Papadopulos, Firoj Alam, Giovanni Da San Martino


Abstract
In today’s fast-paced information era, logical fallacies, defined as defective patterns of reasoning, inevitably contribute to the growth of information disorder. However, often fallacies appear in nuanced forms that complicate automated classification. In this study, we investigate whether merging abstract logical structures with context-level linguistic cues proves beneficial for fallacy classification, developing a framework that inductively extracts such patterns from fallacious examples and their explanations using Large Language Models (LLMs). We evaluate the impact of these patterns across different LLMs and experimental zero- and one-shot configurations, showing statistically significant improvements over zero-shot baselines and outperforming competing approaches. Cross-dataset experiments validate generalization, establishing data-driven pattern extraction as an effective method for generating logical representations.
Anthology ID:
2026.argmining-1.2
Volume:
Proceedings of the 13th Workshop on Argument Mining and Reasoning
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Mohamed Elaraby, Annette Hautli-Janisz, Julia Romberg, Elena Musi, Federico Ruggeri, John Lawrence
Venues:
ArgMining | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5–18
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.argmining-1.2/
DOI:
Bibkey:
Cite (ACL):
Eleni Papadopulos, Firoj Alam, and Giovanni Da San Martino. 2026. Beyond Logical Forms: LLM-Extracted Patterns for Fallacy Classification. In Proceedings of the 13th Workshop on Argument Mining and Reasoning, pages 5–18, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Beyond Logical Forms: LLM-Extracted Patterns for Fallacy Classification (Papadopulos et al., ArgMining 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.argmining-1.2.pdf