Exploring Multilingual Pre-trained Language Model for Aspect-based Sentiment Analysis

Ye Wang, Ruijun Jiang, Zhongqing Wang, Guodong Zhou


Abstract
Aspect-based sentiment analysis has garnered increasing attention in the research community; however, most studies have predominantly focused on English datasets, with other languages such as Chinese, Japanese, and German being neglected due to the limited availability of adequately labeled data. Even within English, labeled data is scarce. To address these challenges, this study investigates the utilization of a multilingual pre-trained setting to leverage resources from diverse languages for aspect-based sentiment analysis. Specifically, we propose a Cross-lingual Knowledge Fusion framework that explores various single-round and two-round bilingual pre-training configurations. This framework utilizes both the original and translated texts, along with their corresponding labels, to pre-train the multilingual model. Evaluation results reveal that our model significantly outperforms state-of-the-art performance across multiple languages, highlighting the effectiveness of the proposed multilingual pre-trained language model for aspect-based sentiment analysis.
Anthology ID:
2026.findings-acl.298
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6011–6023
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.298/
DOI:
Bibkey:
Cite (ACL):
Ye Wang, Ruijun Jiang, Zhongqing Wang, and Guodong Zhou. 2026. Exploring Multilingual Pre-trained Language Model for Aspect-based Sentiment Analysis. In Findings of the Association for Computational Linguistics: ACL 2026, pages 6011–6023, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Exploring Multilingual Pre-trained Language Model for Aspect-based Sentiment Analysis (Wang et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.findings-acl.298.pdf
Checklist:
 2026.findings-acl.298.checklist.pdf