Prompted Aspect Key Point Analysis for Quantitative Review Summarization

An Tang, Xiuzhen Zhang, Minh Dinh, Erik Cambria


Abstract
Key Point Analysis (KPA) aims for quantitative summarization that provides key points (KPs) as succinct textual summaries and quantities measuring their prevalence. KPA studies for arguments and reviews have been reported in the literature. A majority of KPA studies for reviews adopt supervised learning to extract short sentences as KPs before matching KPs to review comments for quantification of KP prevalence. Recent abstractive approaches still generate KPs based on sentences, often leading to KPs with overlapping and hallucinated opinions, and inaccurate quantification. In this paper, we propose Prompted Aspect Key Point Analysis (PAKPA) for quantitative review summarization. PAKPA employs aspect sentiment analysis and prompted in-context learning with Large Language Models (LLMs) to generate and quantify KPs grounded in aspects for business entities, which achieves faithful KPs with accurate quantification, and removes the need for large amounts of annotated data for supervised training. Experiments on the popular review dataset Yelp and the aspect-oriented review summarization dataset SPACE show that our framework achieves state-of-the-art performance. Source code and data are available at: https://github.com/antangrocket1312/PAKPA
Anthology ID:
2024.acl-long.576
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
10691–10708
Language:
URL:
https://preview.aclanthology.org/build-pipeline-with-new-library/2024.acl-long.576/
DOI:
10.18653/v1/2024.acl-long.576
Bibkey:
Cite (ACL):
An Tang, Xiuzhen Zhang, Minh Dinh, and Erik Cambria. 2024. Prompted Aspect Key Point Analysis for Quantitative Review Summarization. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 10691–10708, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Prompted Aspect Key Point Analysis for Quantitative Review Summarization (Tang et al., ACL 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/build-pipeline-with-new-library/2024.acl-long.576.pdf