Optimizing Retrieval-Augmented Generation for E-Commerce How-To Assistance

Gilad Fuchs, Leonid Ekimov, Fei Dong, Jiahong Xie, Wei Liu, Maxim Manco, Alexander Nus


Abstract
Conversational AI is increasingly used at eBay to deliver personalized customer support. We present a production RAG-based How-To Assistant that answers support and how-to queries by grounding responses in a proprietary knowledge base. We study three factors that drive quality: (1) document chunking and contextualization for indexing, (2) query refinement methods, and (3) automatic LLM-based evaluation for rapid iteration and reliable measurement. We also describe the end-to-end system workflow - from offline indexing to real-time serving and report deployment metrics, offering practical guidance for building scalable, high-precision RAG assistants in commercial support settings.
Anthology ID:
2026.acl-industry.31
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Yunyao Li, Georg Rehm, Mei Tu
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
459–466
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-industry.31/
DOI:
Bibkey:
Cite (ACL):
Gilad Fuchs, Leonid Ekimov, Fei Dong, Jiahong Xie, Wei Liu, Maxim Manco, and Alexander Nus. 2026. Optimizing Retrieval-Augmented Generation for E-Commerce How-To Assistance. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026), pages 459–466, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Optimizing Retrieval-Augmented Generation for E-Commerce How-To Assistance (Fuchs et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-industry.31.pdf