Progressive Fine-Tuning for Cost-Effective Structured Attribute Generation in E-commerce

Lakshman Kolasani, Fatemeh Taheri Dezaki


Abstract
Large language models (LLMs) excel at structured information generation but face cost and latency challenges when deployed at scale in user-facing products. We present a parameter efficient supervised fine-tuning pipeline for adapting a small language model (SLM) to structured attribute generation in e-commerce product listing, enabling continuous model improvement with implicit user feedback without expensive manual annotation. Our approach involves completeness-deficit guided curation, which ranks samples by divergence between model predictions and catalog listing attributes, selecting the highest completeness gap examples for progressive fine-tuning. Our system is deployed on a large-scale product listing service, reducing inference costs by 98% and p90 latency by 70% using a fine-tuned SLM relative to the baseline LLM while preserving an 86.4% user acceptance rate, translating to significant monthly infrastructure savings.
Anthology ID:
2026.acl-industry.40
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Yunyao Li, Georg Rehm, Mei Tu
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
585–591
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-industry.40/
DOI:
Bibkey:
Cite (ACL):
Lakshman Kolasani and Fatemeh Taheri Dezaki. 2026. Progressive Fine-Tuning for Cost-Effective Structured Attribute Generation in E-commerce. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026), pages 585–591, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Progressive Fine-Tuning for Cost-Effective Structured Attribute Generation in E-commerce (Kolasani & Dezaki, ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-industry.40.pdf