Understanding LLM Reasoning for Abstractive Summarization

Haohan Yuan, Haopeng Zhang


Abstract
Reasoning has substantially improved Large Language Models (LLMs) on analytical tasks such as mathematics and code generation, but its value for abstractive summarization remains unclear. To address this gap, we adapt general reasoning strategies to the summarization setting and conduct a large-scale comparative study of 8 reasoning strategies and 3 Large Reasoning Models (LRMs) across 8 diverse datasets, evaluating both summary quality and factual faithfulness. Our results show that reasoning is not a universal solution and its effectiveness depends strongly on the strategy and the summarization setting. In particular, we find a trade-off between summary quality and factual faithfulness. Explicit reasoning strategies often improve reference-based quality, but may weaken factual grounding, whereas implicit reasoning in LRMs shows the opposite tendency. We further find that increasing an LRM’s internal reasoning budget does not reliably improve summarization and can even reduce factual consistency. These findings suggest that, for summarization, more reasoning is not always better. Effective reasoning should preserve faithful compression rather than induce over-elaboration.
Anthology ID:
2026.findings-acl.859
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
17360–17386
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.859/
DOI:
Bibkey:
Cite (ACL):
Haohan Yuan and Haopeng Zhang. 2026. Understanding LLM Reasoning for Abstractive Summarization. In Findings of the Association for Computational Linguistics: ACL 2026, pages 17360–17386, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Understanding LLM Reasoning for Abstractive Summarization (Yuan & Zhang, Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.859.pdf
Checklist:
 2026.findings-acl.859.checklist.pdf