Where Did That Come From? Sentence-Level Error-Tolerant Attribution

Ori Ernst, Aviv Slobodkin, Meng Cao, Sihui Wei, Jackie CK Cheung


Abstract
Attribution is the process of identifying which parts of the source support a generated output. While attribution can help users verify content and assess faithfulness, existing task definitions typically exclude unsupported or hallucinated content leaving them unattributed, overlooking the potential to increase faithfulness certainty, locate the error, and fix it easier.In this paper, we propose a new definition for sentence-level error-tolerant attribution, which extends attribution to include incorrect or hallucinated content. We introduce a benchmark for this task and evaluate a range of models on it. Our results show that sentence-level error-tolerant attribution improves the quality of both automatic and manual faithfulness evaluations, reducing annotation time by 30% in long-document settings, and facilitates hallucination fixing. We also find that unfaithful outputs are often linked to sentences that appear later in the source or contain non-literal language, pointing to promising avenues for hallucination mitigation. Our approach offers a better user experience along with improved faithfulness evaluation, with better understanding of model behavior.
Anthology ID:
2025.findings-emnlp.339
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6400–6417
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.339/
DOI:
10.18653/v1/2025.findings-emnlp.339
Bibkey:
Cite (ACL):
Ori Ernst, Aviv Slobodkin, Meng Cao, Sihui Wei, and Jackie CK Cheung. 2025. Where Did That Come From? Sentence-Level Error-Tolerant Attribution. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 6400–6417, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Where Did That Come From? Sentence-Level Error-Tolerant Attribution (Ernst et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.339.pdf
Checklist:
 2025.findings-emnlp.339.checklist.pdf