hdharpure at SemEval-2026 Task 3: BERT-Based Modeling and Prediction Behavior Analysis for Multilingual Valence–Arousal Scoring

Harshal Dharpure, Nicolay Rusnachenko


Abstract
The SemEval-2026 Task 3 is a Dimensional aspect-based sentiment analysis (DimABSA) task which extends traditional ABSA by predicting continuous regression in two dimensions: valence (V) and arousal (A). The Track A/Subtask 1 represent multilingual task in which for a given text and aspects mentioned in it, there is a need to predict V/A scores for each aspect. Our approach is based on the pretraining-finetuning concept: we first pretrain multilingual model (M ′) followed by its fine-tuning (M ′′ l,d) on the training data of specific domain (d) and language (l). We adopt XLM-RoBERTa (M ) as the encoder with separate regression heads for valence and arousal prediction. Our experiments on manual split of official SemEval-2026 Task 3 dataset (D20% train) demonstrate that fine-tuning model in two stages (M ′′ l,d) results in average ≈ 1.36 times improvement by RMSEva over approach of direct fine-tuning (Ml,d). To investigate limitations of the existing approach we visualize and discuss limitations of our system. Our code is publicly available.
Anthology ID:
2026.semeval-1.281
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2228–2232
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.281/
DOI:
Bibkey:
Cite (ACL):
Harshal Dharpure and Nicolay Rusnachenko. 2026. hdharpure at SemEval-2026 Task 3: BERT-Based Modeling and Prediction Behavior Analysis for Multilingual Valence–Arousal Scoring. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2228–2232, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
hdharpure at SemEval-2026 Task 3: BERT-Based Modeling and Prediction Behavior Analysis for Multilingual Valence–Arousal Scoring (Dharpure & Rusnachenko, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.281.pdf
Supplementarymaterial:
 2026.semeval-1.281.SupplementaryMaterial.zip