Relevance to Utility: Process-Supervised Rewrite for RAG
Jaeyoung Kim, Jongho Kim, Seung-won Hwang, Seoho Song, Young-In Song
Abstract
Retrieval-augmented generation systems often suffer from a gap between optimizing retrieval relevance and generative utility. With such a gap, retrieved documents may be topically relevant but still lack the content needed for effective reasoning during generation. While existing bridge modules attempt to rewrite the retrieved text for better generation, we show how they fail by not capturing "document utility". In this work, we propose R2U, with a key distinction of approximating true utility through joint observation of rewriting and answering in the reasoning process. To distill this observation reliably, R2U scales such supervision to enhance reliability in distillation. We further construct utility-improvement supervision by measuring the generator’s gain of the answer under the rewritten context, yielding signals for fine-tuning and preference optimization. We evaluate our method across multiple open-domain question-answering benchmarks. The empirical results demonstrate consistent improvements over strong bridging baselines.- Anthology ID:
- 2026.findings-acl.1513
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 30274–30293
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1513/
- DOI:
- Cite (ACL):
- Jaeyoung Kim, Jongho Kim, Seung-won Hwang, Seoho Song, and Young-In Song. 2026. Relevance to Utility: Process-Supervised Rewrite for RAG. In Findings of the Association for Computational Linguistics: ACL 2026, pages 30274–30293, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- Relevance to Utility: Process-Supervised Rewrite for RAG (Kim et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1513.pdf