Entity-Level Sentiment Analysis with Sentence Relevance Detection

Egil Rønningstad, Roman Klinger, Lilja Øvrelid, Erik Velldal


Abstract
The task of entity-level sentiment analysis (Elsa) is to extract sentiment scores for a given entity (such as person names or organization names) from a text. Elsa is a challenging task and involves processing of longer documents, where several entities may be mentioned with varying importance for the final score aggregation. Fine-tuning encoder-based Transformers (such as BERT) constitutes the state of the art for sentiment predictions, however, these models are still limited by their restricted input lengths. Decoder-only models so far still underperform on the task. We approach the context limitation by learning to extract segments that are relevant for the sentiment prediction for a given entity, without preprocessing by chunking and aggregation. For decoder models, we explore fine-tuning these through supervised fine-tuning and pairwise comparison, a method borrowed from reward modeling for preference optimization. Both methods perform well and set a new standard for the Elsa task. We further show that pairwise classification is faster, simpler, and shows less variance than the more common direct supervision for this task.
Anthology ID:
2026.lrec-main.638
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
8040–8055
Language:
URL:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.638/
DOI:
Bibkey:
Cite (ACL):
Egil Rønningstad, Roman Klinger, Lilja Øvrelid, and Erik Velldal. 2026. Entity-Level Sentiment Analysis with Sentence Relevance Detection. International Conference on Language Resources and Evaluation, main:8040–8055.
Cite (Informal):
Entity-Level Sentiment Analysis with Sentence Relevance Detection (Rønningstad et al., LREC 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.638.pdf