Is Agentic RAG worth it? An experimental comparison of RAG approaches
Pietro Ferrazzi, Milica Cvjetićanin, Alessio Piraccini, Davide Giannuzzi
Abstract
Retrieval-Augmented Generation (RAG) systems are usually defined by the combination of a generator and a retrieval component that extracts textual context from a knowledge base to answer user queries. However, such basic implementations exhibit several limitations, including noisy or suboptimal retrieval, misuse of retrieval for out-of-scope queries, weak query–document matching, and variability or cost associated with the generator. These shortcomings have motivated the development of "Enhanced" RAG, where dedicated modules are introduced to address specific weaknesses in the workflow.More recently, the growing self-reflective capabilities of Large Language Models (LLMs) have enabled a new paradigm, often referred to as "Agentic" RAG. In this approach, an LLM orchestrates the entire process, deciding which actions to perform, when to perform them, and whether to iterate. Despite the rapid adoption of both paradigms, it remains unclear which approach is preferable under which conditions.In this work, we conduct an empirically driven evaluation of "Enhanced" and "Agentic" RAG across multiple scenarios and dimensions. Our results provide practical insights into the trade-offs between the two paradigms, offering guidance on selecting the most effective RAG design for real-world applications, considering both performance and costs.- Anthology ID:
- 2026.acl-industry.5
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Yunyao Li, Georg Rehm, Mei Tu
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 56–75
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-industry.5/
- DOI:
- Cite (ACL):
- Pietro Ferrazzi, Milica Cvjetićanin, Alessio Piraccini, and Davide Giannuzzi. 2026. Is Agentic RAG worth it? An experimental comparison of RAG approaches. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026), pages 56–75, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- Is Agentic RAG worth it? An experimental comparison of RAG approaches (Ferrazzi et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-industry.5.pdf