Structured Dialogue Refinement: Building Retrieval-Augmented Question Answering on Goal-Oriented Dialogues

Bin Wu, Sawan Kumar, Prasetya Ajie Utama, Mohamed Yahya


Abstract
Retrieval-Augmented Generation (RAG) is widely used for question answering over well-structured document corpora. However, a large amount of real-world problem-solving knowledge is captured in goal-oriented dialogues, where common ground misalignment between users and helpers gives rise to sparse, diffuse, and dynamically refined evidence that challenges standard RAG pipelines. We propose Structured Dialogue Refinement (SDR), a unified framework that adapts dialogue corpora for RAG at both the retrieval and generation stages without altering the underlying pipeline. Specifically, SDR introduces Dual Dialogue Querying for intent-aligned retrieval via issue-centric and solution-centric pseudo-documents, and Graph-Structured Dialogues coupled with a relevance-driven subgraph selection strategy to enable effective utilization of conversational evidence. We further adopt a nugget-based evaluation setup for dialogue-grounded RAG, enabling fine-grained analysis of retrieval coverage and grounded answer generation. Experiments demonstrate that SDR substantially improves both retrieval quality and grounded QA performance under dialogue-specific structural challenges.
Anthology ID:
2026.findings-acl.1571
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
31419–31432
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1571/
DOI:
Bibkey:
Cite (ACL):
Bin Wu, Sawan Kumar, Prasetya Ajie Utama, and Mohamed Yahya. 2026. Structured Dialogue Refinement: Building Retrieval-Augmented Question Answering on Goal-Oriented Dialogues. In Findings of the Association for Computational Linguistics: ACL 2026, pages 31419–31432, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Structured Dialogue Refinement: Building Retrieval-Augmented Question Answering on Goal-Oriented Dialogues (Wu et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1571.pdf
Checklist:
 2026.findings-acl.1571.checklist.pdf