Aligning Black-Box LLMs for Aspect Sentiment Quad Prediction

Shichen Li, Jiawei Zhang, Zhongqing Wang, Peifeng Li


Abstract
Aspect-Based Sentiment Analysis (ABSA) focuses on extracting opinions about specific aspects, with Aspect Sentiment Quad Prediction (ASQP) being the most complex sub-task. Large language models (LLMs) like GPT4 exhibit strong generalization yet struggle with ASQP due to a lack of task-specific alignment. Supervised small language models (SLMs), while effective in capturing task-specific patterns, lack the extensive knowledge of LLMs. To address this, we propose a framework that combines SLMs and LLMs using supervised in-context learning to align LLM outputs with human preferences. One SLM is supervised to generate candidate answers and guide LLMs with task-specific instructions, while another SLM acts as a reward model iteratively evaluates and refines LLM outputs. Experiments show that our framework significantly improves ASQP performance, demonstrating robustness, scalability, and potential for advancing alignment techniques in sentiment analysis.
Anthology ID:
2025.findings-emnlp.53
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1012–1025
Language:
URL:
https://preview.aclanthology.org/ingest-luhme/2025.findings-emnlp.53/
DOI:
10.18653/v1/2025.findings-emnlp.53
Bibkey:
Cite (ACL):
Shichen Li, Jiawei Zhang, Zhongqing Wang, and Peifeng Li. 2025. Aligning Black-Box LLMs for Aspect Sentiment Quad Prediction. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 1012–1025, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Aligning Black-Box LLMs for Aspect Sentiment Quad Prediction (Li et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-luhme/2025.findings-emnlp.53.pdf
Checklist:
 2025.findings-emnlp.53.checklist.pdf