Optimizing Retrieval-Augmented Generation for E-Commerce How-To Assistance
Gilad Fuchs, Leonid Ekimov, Fei Dong, Jiahong Xie, Wei Liu, Maxim Manco, Alexander Nus
Abstract
Conversational AI is increasingly used at eBay to deliver personalized customer support. We present a production RAG-based How-To Assistant that answers support and how-to queries by grounding responses in a proprietary knowledge base. We study three factors that drive quality: (1) document chunking and contextualization for indexing, (2) query refinement methods, and (3) automatic LLM-based evaluation for rapid iteration and reliable measurement. We also describe the end-to-end system workflow - from offline indexing to real-time serving and report deployment metrics, offering practical guidance for building scalable, high-precision RAG assistants in commercial support settings.- Anthology ID:
- 2026.acl-industry.31
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Yunyao Li, Georg Rehm, Mei Tu
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 459–466
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-industry.31/
- DOI:
- Cite (ACL):
- Gilad Fuchs, Leonid Ekimov, Fei Dong, Jiahong Xie, Wei Liu, Maxim Manco, and Alexander Nus. 2026. Optimizing Retrieval-Augmented Generation for E-Commerce How-To Assistance. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026), pages 459–466, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- Optimizing Retrieval-Augmented Generation for E-Commerce How-To Assistance (Fuchs et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-industry.31.pdf