Leveraging Only the Category Name for Aspect Detection through Prompt-based Constrained Clustering
Yazheng Li, Pengyun Wang, Yasheng Wang, Yong Dai, Yadao Wang, Lujia Pan, Zenglin Xu
Abstract
Aspect category detection (ACD) aims to automatically identify user-concerned aspects from online reviews, which is of great value for evaluating the fine-grained performance of a product. The most recent solutions tackle this problem via weakly supervised methods, achieving remarkable improvement over unsupervised methods. However, a closer look at these methods reveals that the required human efforts are nontrivial and can sometimes be hard to obtain. In this study, we explore the possibility of minimizing human guidance while improving detection performance, with a deep clustering method that relies merely on the category name of each aspect and a pretrained language model (LM). The LM, combined with prompt techniques, is employed as a knowledge base to automatically generate constraints for clustering, as well as to provide a representation space to perform the clustering. Our method (1) extracts extensive keywords to expand our understanding of each aspect, (2) automatically generates instance-level and concept-level constraints for clustering, and (3) trains the clustering model with the above constraints. We demonstrate the capability of the proposed framework through extensive experiments on nine benchmark datasets. Our model not only performs noticeably better than existing unsupervised approaches but also considerably surpasses weakly supervised methods that require more human efforts.- Anthology ID:
- 2022.findings-emnlp.97
- Volume:
- Findings of the Association for Computational Linguistics: EMNLP 2022
- Month:
- December
- Year:
- 2022
- Address:
- Abu Dhabi, United Arab Emirates
- Editors:
- Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1352–1364
- Language:
- URL:
- https://aclanthology.org/2022.findings-emnlp.97
- DOI:
- 10.18653/v1/2022.findings-emnlp.97
- Cite (ACL):
- Yazheng Li, Pengyun Wang, Yasheng Wang, Yong Dai, Yadao Wang, Lujia Pan, and Zenglin Xu. 2022. Leveraging Only the Category Name for Aspect Detection through Prompt-based Constrained Clustering. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 1352–1364, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
- Cite (Informal):
- Leveraging Only the Category Name for Aspect Detection through Prompt-based Constrained Clustering (Li et al., Findings 2022)
- PDF:
- https://preview.aclanthology.org/ingest-bitext-workshop/2022.findings-emnlp.97.pdf