Offensive Language Identification in Transliterated and Code-Mixed Bangla
Md Nishat Raihan, Umma Tanmoy, Anika Binte Islam, Kai North, Tharindu Ranasinghe, Antonios Anastasopoulos, Marcos Zampieri
Abstract
Identifying offensive content in social media is vital to create safe online communities. Several recent studies have addressed this problem by creating datasets for various languages. In this paper, we explore offensive language identification in texts with transliterations and code-mixing, linguistic phenomena common in multilingual societies, and a known challenge for NLP systems. We introduce TB-OLID, a transliterated Bangla offensive language dataset containing 5,000 manually annotated comments. We train and fine-tune machine learning models on TB-OLID, and we evaluate their results on this dataset. Our results show that English pre-trained transformer-based models, such as fBERT and HateBERT achieve the best performance on this dataset.- Anthology ID:
- 2023.banglalp-1.1
- Volume:
- Proceedings of the First Workshop on Bangla Language Processing (BLP-2023)
- Month:
- December
- Year:
- 2023
- Address:
- Singapore
- Editors:
- Firoj Alam, Sudipta Kar, Shammur Absar Chowdhury, Farig Sadeque, Ruhul Amin
- Venue:
- BanglaLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1–6
- Language:
- URL:
- https://aclanthology.org/2023.banglalp-1.1
- DOI:
- 10.18653/v1/2023.banglalp-1.1
- Cite (ACL):
- Md Nishat Raihan, Umma Tanmoy, Anika Binte Islam, Kai North, Tharindu Ranasinghe, Antonios Anastasopoulos, and Marcos Zampieri. 2023. Offensive Language Identification in Transliterated and Code-Mixed Bangla. In Proceedings of the First Workshop on Bangla Language Processing (BLP-2023), pages 1–6, Singapore. Association for Computational Linguistics.
- Cite (Informal):
- Offensive Language Identification in Transliterated and Code-Mixed Bangla (Raihan et al., BanglaLP 2023)
- PDF:
- https://preview.aclanthology.org/ingest-2024-clasp/2023.banglalp-1.1.pdf