Abstract
Analyzing public sentiment on social media is helpful in understanding the public’s emotions about any given topic. While numerous studies have been conducted in this field, there has been limited research on Bangla social media data. Team M1437 from George Mason University participated in the Sentiment Analysis shared task of the Bangla Language Processing (BLP) Workshop at EMNLP-2023. The team fine-tuned various BERT-based Transformer architectures to solve the task. This article shows that BanglaBERTlarge, a language model pre-trained on Bangla text, outperformed other BERT-based models. This model achieved an F1 score of 73.15% and top position in the development phase, was further tuned with external training data, and achieved an F1 score of 70.36% in the evaluation phase, securing the fourteenth place on the leaderboard. The F1 score on the test set, when BanglaBERTlarge was trained without external training data, was 71.54%.- Anthology ID:
- 2023.banglalp-1.36
- Volume:
- Proceedings of the First Workshop on Bangla Language Processing (BLP-2023)
- Month:
- December
- Year:
- 2023
- Address:
- Singapore
- Editors:
- Firoj Alam, Sudipta Kar, Shammur Absar Chowdhury, Farig Sadeque, Ruhul Amin
- Venue:
- BanglaLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 279–285
- Language:
- URL:
- https://aclanthology.org/2023.banglalp-1.36
- DOI:
- 10.18653/v1/2023.banglalp-1.36
- Cite (ACL):
- Majidur Rahman and Ozlem Uzuner. 2023. M1437 at BLP-2023 Task 2: Harnessing Bangla Text for Sentiment Analysis: A Transformer-based Approach. In Proceedings of the First Workshop on Bangla Language Processing (BLP-2023), pages 279–285, Singapore. Association for Computational Linguistics.
- Cite (Informal):
- M1437 at BLP-2023 Task 2: Harnessing Bangla Text for Sentiment Analysis: A Transformer-based Approach (Rahman & Uzuner, BanglaLP 2023)
- PDF:
- https://preview.aclanthology.org/emnlp-22-attachments/2023.banglalp-1.36.pdf