AutoQual: An LLM Agent for Automated Discovery of Interpretable Features for Review Quality Assessment

Xiaochong Lan, Jie Feng, Yinxing Liu, Xinleishi, Yong Li


Abstract
Ranking online reviews by their intrinsic quality is a critical task for e-commerce platforms and information services, impacting user experience and business outcomes. However, quality is a domain-dependent and dynamic concept, making its assessment a formidable challenge. Traditional methods relying on hand-crafted features are unscalable across domains and fail to adapt to evolving content patterns, while modern deep learning approaches often produce black-box models that lack interpretability and may prioritize semantics over quality. To address these challenges, we propose AutoQual, an LLM-based agent framework that automates the discovery of interpretable features. While demonstrated on review quality assessment, AutoQual is designed as a general framework for transforming tacit knowledge embedded in data into explicit, computable features. It mimics a human research process, iteratively generating feature hypotheses through reflection, operationalizing them via autonomous tool implementation, and accumulating experience in a persistent memory. We deploy our method on a large-scale online platform with a billion-level user base. Large-scale A/B testing confirms its effectiveness, increasing average reviews viewed per user by 0.79% and the conversion rate of review readers by 0.27%.
Anthology ID:
2025.emnlp-industry.87
Volume:
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
November
Year:
2025
Address:
Suzhou (China)
Editors:
Saloni Potdar, Lina Rojas-Barahona, Sebastien Montella
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1250–1264
Language:
URL:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-industry.87/
DOI:
Bibkey:
Cite (ACL):
Xiaochong Lan, Jie Feng, Yinxing Liu, Xinleishi, and Yong Li. 2025. AutoQual: An LLM Agent for Automated Discovery of Interpretable Features for Review Quality Assessment. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 1250–1264, Suzhou (China). Association for Computational Linguistics.
Cite (Informal):
AutoQual: An LLM Agent for Automated Discovery of Interpretable Features for Review Quality Assessment (Lan et al., EMNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-industry.87.pdf