FactAppeal: Identifying Epistemic Factual Appeals in News Media

Guy Mor-Lan, Tamir Sheafer, Shaul R. Shenhav


Abstract
How is a factual claim made credible? We propose the novel task of Epistemic Appeal Identification, which identifies whether and how factual statements have been anchored by external sources or evidence. To advance research on this task, we present FactAppeal, a manually annotated dataset of 3,226 English-language news sentences. Unlike prior resources that focus solely on claim detection and verification, FactAppeal identifies the nuanced epistemic structures and evidentiary basis underlying these claims and used to support them. FactAppeal contains span-level annotations which identify factual statements and mentions of sources on which they rely. Moreover, the annotations include fine-grained characteristics of factual appeals such as the type of source (e.g. Active Participant, Witness, Expert, Direct Evidence), whether it is mentioned by name, mentions of the source’s role and epistemic credentials, attribution to the source via direct or indirect quotation, and other features. We model the task with a range of encoder models and generative decoder models in the 2B-9B parameter range. Our best performing model, based on Gemma 2 9B, achieves a macro-F1 score of 0.73.
Anthology ID:
2026.findings-eacl.344
Volume:
Findings of the Association for Computational Linguistics: EACL 2026
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6545–6556
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.findings-eacl.344/
DOI:
Bibkey:
Cite (ACL):
Guy Mor-Lan, Tamir Sheafer, and Shaul R. Shenhav. 2026. FactAppeal: Identifying Epistemic Factual Appeals in News Media. In Findings of the Association for Computational Linguistics: EACL 2026, pages 6545–6556, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
FactAppeal: Identifying Epistemic Factual Appeals in News Media (Mor-Lan et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.findings-eacl.344.pdf
Checklist:
 2026.findings-eacl.344.checklist.pdf