Investigating the Effectiveness of Graph-based Algorithm for Bangla Text Classification
Farhan Dehan, Md Fahim, Amin Ahsan Ali, M Ashraful Amin, Akmmahbubur Rahman
Abstract
In this study, we examine and analyze the behavior of several graph-based models for Bangla text classification tasks. Graph-based algorithms create heterogeneous graphs from text data. Each node represents either a word or a document, and each edge indicates relationship between any two words or word and document. We applied the BERT model and different graph-based models including TextGCN, GAT, BertGAT, and BertGCN on five different datasets including SentNoB, Sarcasm detection, BanFakeNews, Hate speech detection, and Emotion detection datasets for Bangla text. BERT’s model bested the TextGCN and the GAT models by a large difference in terms of accuracy, Macro F1 score, and weighted F1 score. BertGCN and BertGAT are shown to outperform standalone graph models and BERT model. BertGAT excelled in the Emotion detection dataset and achieved a 1%-2% performance boost in Sarcasm detection, Hate speech detection, and BanFakeNews datasets from BERT’s performance. Whereas, BertGCN outperformed BertGAT by 1% for SetNoB, and BanFakeNews datasets while beating BertGAT by 2% for Sarcasm detection, Hate Speech, and Emotion detection datasets. We also examined different variations in graph structure and analyzed their effects.- Anthology ID:
- 2023.banglalp-1.12
- Volume:
- Proceedings of the First Workshop on Bangla Language Processing (BLP-2023)
- Month:
- December
- Year:
- 2023
- Address:
- Singapore
- Editors:
- Firoj Alam, Sudipta Kar, Shammur Absar Chowdhury, Farig Sadeque, Ruhul Amin
- Venue:
- BanglaLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 104–116
- Language:
- URL:
- https://aclanthology.org/2023.banglalp-1.12
- DOI:
- 10.18653/v1/2023.banglalp-1.12
- Cite (ACL):
- Farhan Dehan, Md Fahim, Amin Ahsan Ali, M Ashraful Amin, and Akmmahbubur Rahman. 2023. Investigating the Effectiveness of Graph-based Algorithm for Bangla Text Classification. In Proceedings of the First Workshop on Bangla Language Processing (BLP-2023), pages 104–116, Singapore. Association for Computational Linguistics.
- Cite (Informal):
- Investigating the Effectiveness of Graph-based Algorithm for Bangla Text Classification (Dehan et al., BanglaLP 2023)
- PDF:
- https://preview.aclanthology.org/emnlp-22-attachments/2023.banglalp-1.12.pdf