Modeling Background Knowledge with Frame Semantics for Fine-grained Sentiment Classification

Muhammad Okky Ibrohim, Valerio Basile, Danilo Croce, Cristina Bosco, Roberto Basili


Abstract
Few-shot learning via in-context learning (ICL) is widely used in NLP, but its effectiveness is highly sensitive to example selection, often leading to unstable performance. To address this, we introduce BacKGen, a framework for generating structured Background Knowledge (BK) as an alternative to instance-based prompting. Our approach leverages Frame Semantics to uncover recurring conceptual patterns across data instances, clustering examples based on shared event structures and semantic roles. These patterns are then synthesized into generalized knowledge statements using a large language model (LLM) and injected into prompts to support contextual reasoning beyond surface-level cues. We apply BacKGen to Sentiment Phrase Classification (SPC), a task where polarity judgments frequently depend on implicit commonsense knowledge. In this setting, BK serves as an abstract representation of prototypical scenarios, enabling schematic generalization to help the model perform analogical reasoning by mapping new inputs onto generalized event structures. Experimental results with Mistral-7B and Llama3-8B demonstrate that BK-based prompting consistently outperforms standard few-shot approaches, achieving up to 29.94% error reduction.
Anthology ID:
2025.analogyangle-1.3
Volume:
Proceedings of the 2nd Workshop on Analogical Abstraction in Cognition, Perception, and Language (Analogy-Angle II)
Month:
August
Year:
2025
Address:
Vienna, Austria
Editors:
Giulia Rambelli, Filip Ilievski, Marianna Bolognesi, Pia Sommerauer
Venues:
Analogy-Angle | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
22–36
Language:
URL:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.analogyangle-1.3/
DOI:
Bibkey:
Cite (ACL):
Muhammad Okky Ibrohim, Valerio Basile, Danilo Croce, Cristina Bosco, and Roberto Basili. 2025. Modeling Background Knowledge with Frame Semantics for Fine-grained Sentiment Classification. In Proceedings of the 2nd Workshop on Analogical Abstraction in Cognition, Perception, and Language (Analogy-Angle II), pages 22–36, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Modeling Background Knowledge with Frame Semantics for Fine-grained Sentiment Classification (Ibrohim et al., Analogy-Angle 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/acl25-workshop-ingestion/2025.analogyangle-1.3.pdf