Feedback Adaptation for Retrieval-Augmented Generation

Jihwan Bang, Seunghan Yang, Kyuhong Shim, Simyung Chang, Juntae Lee, Sungha Choi


Abstract
Retrieval-Augmented Generation (RAG) systems are typically evaluated under static assumptions, despite being frequently corrected through user or expert feedback in deployment. Existing evaluation protocols focus on overall accuracy and fail to capture how systems adapt after feedback is introduced. We introduce feedback adaptation as a problem setting for RAG systems, which asks how effectively and how quickly corrective feedback propagates to future queries. To make this behavior measurable, we propose two evaluation axes: correction lag, which captures the delay between feedback provision and behavioral change, and post-feedback performance, which measures reliability on semantically related queries after feedback. Using these metrics, we show that training-based approaches exhibit a trade-off between delayed correction and reliable adaptation. We further propose PatchRAG, a minimal inference-time instantiation that incorporates feedback without retraining, demonstrating immediate correction and strong post-feedback generalization under the proposed evaluation. Our results highlight feedback adaptation as a previously overlooked dimension of RAG system behavior in interactive settings.
Anthology ID:
2026.findings-acl.1419
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
28472–28485
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1419/
DOI:
Bibkey:
Cite (ACL):
Jihwan Bang, Seunghan Yang, Kyuhong Shim, Simyung Chang, Juntae Lee, and Sungha Choi. 2026. Feedback Adaptation for Retrieval-Augmented Generation. In Findings of the Association for Computational Linguistics: ACL 2026, pages 28472–28485, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Feedback Adaptation for Retrieval-Augmented Generation (Bang et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1419.pdf
Checklist:
 2026.findings-acl.1419.checklist.pdf