Hate and Offensive Keyword Extraction from CodeMix Malayalam Social Media Text Using Contextual Embedding
Mariya Raphel, Premjith B, Sreelakshmi K, Bharathi Raja Chakravarthi
Abstract
This paper focuses on identifying hate and offensive keywords from codemix Malayalam social media text. As part of this work, a dataset for hate and offensive keyword extraction for codemix Malayalam language was created. Two different methods were experimented to extract Hate and Offensive language (HOL) keywords from social media text. In the first method, intrinsic evaluation was performed on the dataset to identify the hate and offensive keywords. Three different approaches namely – unigram approach, bigram approach and trigram approach were performed to extract the HOL keywords, sequence of HOL words and the sequence that contribute HOL meaning even in the absence of a HOL word. Five different transformer models were used in each of the pproaches for extracting the embeddings for the ngrams. Later, HOL keywords were extracted based on the similarity score obtained using the cosine similarity. Out of the five transformer models, the best results were obtained with multilingual BERT. In the second method, multilingual BERT transformer model was fine tuned with the dataset to develop a HOL keyword tagger model. This work is a new beginning for HOL keyword identification in Dravidian language – Malayalam.- Anthology ID:
- 2023.dravidianlangtech-1.2
- Volume:
- Proceedings of the Third Workshop on Speech and Language Technologies for Dravidian Languages
- Month:
- September
- Year:
- 2023
- Address:
- Varna, Bulgaria
- Editors:
- Bharathi R. Chakravarthi, Ruba Priyadharshini, Anand Kumar M, Sajeetha Thavareesan, Elizabeth Sherly
- Venues:
- DravidianLangTech | WS
- SIG:
- Publisher:
- INCOMA Ltd., Shoumen, Bulgaria
- Note:
- Pages:
- 10–18
- Language:
- URL:
- https://aclanthology.org/2023.dravidianlangtech-1.2
- DOI:
- Cite (ACL):
- Mariya Raphel, Premjith B, Sreelakshmi K, and Bharathi Raja Chakravarthi. 2023. Hate and Offensive Keyword Extraction from CodeMix Malayalam Social Media Text Using Contextual Embedding. In Proceedings of the Third Workshop on Speech and Language Technologies for Dravidian Languages, pages 10–18, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
- Cite (Informal):
- Hate and Offensive Keyword Extraction from CodeMix Malayalam Social Media Text Using Contextual Embedding (Raphel et al., DravidianLangTech-WS 2023)
- PDF:
- https://preview.aclanthology.org/proper-vol2-ingestion/2023.dravidianlangtech-1.2.pdf