Painsight: An Extendable Opinion Mining Framework for Detecting Pain Points Based on Online Customer Reviews
Yukyung Lee, Jaehee Kim, Doyoon Kim, Yookyung Kho, Younsun Kim, Pilsung Kang
Abstract
As the e-commerce market continues to expand and online transactions proliferate, customer reviews have emerged as a critical element in shaping the purchasing decisions of prospective buyers. Previous studies have endeavored to identify key aspects of customer reviews through the development of sentiment analysis models and topic models. However, extracting specific dissatisfaction factors remains a challenging task. In this study, we delineate the pain point detection problem and propose Painsight, an unsupervised framework for automatically extracting distinct dissatisfaction factors from customer reviews without relying on ground truth labels. Painsight employs pre-trained language models to construct sentiment analysis and topic models, leveraging attribution scores derived from model gradients to extract dissatisfaction factors. Upon application of the proposed methodology to customer review data spanning five product categories, we successfully identified and categorized dissatisfaction factors within each group, as well as isolated factors for each type. Notably, Painsight outperformed benchmark methods, achieving substantial performance enhancements and exceptional results in human evaluations.- Anthology ID:
- 2023.wassa-1.20
- Volume:
- Proceedings of the 13th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Jeremy Barnes, Orphée De Clercq, Roman Klinger
- Venue:
- WASSA
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 215–227
- Language:
- URL:
- https://aclanthology.org/2023.wassa-1.20
- DOI:
- 10.18653/v1/2023.wassa-1.20
- Cite (ACL):
- Yukyung Lee, Jaehee Kim, Doyoon Kim, Yookyung Kho, Younsun Kim, and Pilsung Kang. 2023. Painsight: An Extendable Opinion Mining Framework for Detecting Pain Points Based on Online Customer Reviews. In Proceedings of the 13th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis, pages 215–227, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- Painsight: An Extendable Opinion Mining Framework for Detecting Pain Points Based on Online Customer Reviews (Lee et al., WASSA 2023)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-5/2023.wassa-1.20.pdf