Derek Ho
2026
DQA: Diagnostic Question Answering for IT Support
Vishaal Kapoor | Mariam Dundua | Evren Yortucboylu | Sarthak Ahuja | Neda Kordjazi | Yiming Li | Vaibhavi padala | Derek Ho | Jennifer Whitted | Rebecca Steinert
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
Vishaal Kapoor | Mariam Dundua | Evren Yortucboylu | Sarthak Ahuja | Neda Kordjazi | Yiming Li | Vaibhavi padala | Derek Ho | Jennifer Whitted | Rebecca Steinert
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
Enterprise IT support interactions are fundamentally diagnostic: effective resolution requires iterative evidence gathering from ambiguous user reports to identify an underlying root cause. While retrieval-augmented generation (RAG) provides grounding through historical cases, standard multi-turn RAG systems lack explicit diagnostic state and therefore struggle to accumulate evidence and resolve competing hypotheses across turns.We introduce DQA, a diagnostic question-answering framework that maintains persistent diagnostic state and aggregates retrieved cases at the level of root causes rather than individual documents. DQA combines conversational query rewriting, retrieval aggregation, and state-conditioned response generation to support systematic troubleshooting under enterprise latency and context constraints.We evaluate DQA on 150 anonymized enterprise IT support scenarios using a replay-based protocol. Averaged over three independent runs, DQA achieves a 78.7% success rate under a trajectory-level success criterion, compared to 41.3% for a multi-turn RAG baseline, while reducing average turns from 8.4 to 3.9. This improvement reflects the benefit of explicitly representing competing explanations and aggregating evidence across turns in unscripted troubleshooting.