PUEB-DimASR at SemEval-2026 Task 3: Escaping the Mean Regression Trap with Graph-Enhanced Transformers for Dimensional Aspect-Based Sentiment Regression

Oskar Riewe-Perła, Agata Filipowska


Abstract
The DimABSA shared task aims to combine dimensional analysis with Aspect-Based Sentiment Analysis (ABSA). It addresses the lack of continuous sentiment representation, as opposed to categorical labels (e.g., positive, negative, or neutral), and enriches it with an assessment of arousal. Our team’s PUEB-DimASR investigates the "mean-regression trap" — the tendency of standard MSE loss in high-dimensional sentiment tasks to over-predict values closer to the global mean. We propose a two-step advancement in model ar chitecture. First, we enhance baseline Trans formers with Graph Convolutional Networks(GCN) to capture syntactic aspect-sentiment dependencies. Second, we evaluate and recommend a Hybrid loss function that combines Mean Squared Error (MSE) and Concordance Correlation Coefficient (CCC).Our proposed GCN-deBERTa model consistently outperforms the baseline across six target languages. While MSE loss yields the best RMSE scores for English (0.876) and Chinese (0.546), it introduces significant variance collapse, which we successfully mitigated using the Hybrid loss, achieving near-perfect distributional alignment (99.6\%). Additionally, our model trained with the Hybrid loss achieved the best RMSE scores for Russian (1.136), Tatar (1.207), and Ukrainian (1.178).
Anthology ID:
2026.semeval-1.53
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
361–366
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.53/
DOI:
Bibkey:
Cite (ACL):
Oskar Riewe-Perła and Agata Filipowska. 2026. PUEB-DimASR at SemEval-2026 Task 3: Escaping the Mean Regression Trap with Graph-Enhanced Transformers for Dimensional Aspect-Based Sentiment Regression. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 361–366, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
PUEB-DimASR at SemEval-2026 Task 3: Escaping the Mean Regression Trap with Graph-Enhanced Transformers for Dimensional Aspect-Based Sentiment Regression (Riewe-Perła & Filipowska, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.53.pdf
Supplementarymaterial:
 2026.semeval-1.53.SupplementaryMaterial.zip