Relevance to Utility: Process-Supervised Rewrite for RAG

Jaeyoung Kim, Jongho Kim, Seung-won Hwang, Seoho Song, Young-In Song


Abstract
Retrieval-augmented generation systems often suffer from a gap between optimizing retrieval relevance and generative utility. With such a gap, retrieved documents may be topically relevant but still lack the content needed for effective reasoning during generation. While existing bridge modules attempt to rewrite the retrieved text for better generation, we show how they fail by not capturing "document utility". In this work, we propose R2U, with a key distinction of approximating true utility through joint observation of rewriting and answering in the reasoning process. To distill this observation reliably, R2U scales such supervision to enhance reliability in distillation. We further construct utility-improvement supervision by measuring the generator’s gain of the answer under the rewritten context, yielding signals for fine-tuning and preference optimization. We evaluate our method across multiple open-domain question-answering benchmarks. The empirical results demonstrate consistent improvements over strong bridging baselines.
Anthology ID:
2026.findings-acl.1513
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
30274–30293
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1513/
DOI:
Bibkey:
Cite (ACL):
Jaeyoung Kim, Jongho Kim, Seung-won Hwang, Seoho Song, and Young-In Song. 2026. Relevance to Utility: Process-Supervised Rewrite for RAG. In Findings of the Association for Computational Linguistics: ACL 2026, pages 30274–30293, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Relevance to Utility: Process-Supervised Rewrite for RAG (Kim et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1513.pdf
Checklist:
 2026.findings-acl.1513.checklist.pdf