hate-alert@DravidianLangTech-ACL2022: Ensembling Multi-Modalities for Tamil TrollMeme Classification

Mithun Das, Somnath Banerjee, Animesh Mukherjee

Abstract
Social media platforms often act as breeding grounds for various forms of trolling or malicious content targeting users or communities. One way of trolling users is by creating memes, which in most cases unites an image with a short piece of text embedded on top of it. The situation is more complex for multilingual(e.g., Tamil) memes due to the lack of benchmark datasets and models. We explore several models to detect Troll memes in Tamil based on the shared task, “Troll Meme Classification in DravidianLangTech2022” at ACL-2022. We observe while the text-based model MURIL performs better for Non-troll meme classification, the image-based model VGG16 performs better for Troll-meme classification. Further fusing these two modalities help us achieve stable outcomes in both classes. Our fusion model achieved a 0.561 weighted average F1 score and ranked second in this task.
Anthology ID:
2022.dravidianlangtech-1.8
Volume:
Proceedings of the Second Workshop on Speech and Language Technologies for Dravidian Languages
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Bharathi Raja Chakravarthi, Ruba Priyadharshini, Anand Kumar Madasamy, Parameswari Krishnamurthy, Elizabeth Sherly, Sinnathamby Mahesan
Venue:
DravidianLangTech
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
51–57
Language:
URL:
https://preview.aclanthology.org/build-pipeline-with-new-library/2022.dravidianlangtech-1.8/
DOI:
10.18653/v1/2022.dravidianlangtech-1.8
Bibkey:
Cite (ACL):
Mithun Das, Somnath Banerjee, and Animesh Mukherjee. 2022. hate-alert@DravidianLangTech-ACL2022: Ensembling Multi-Modalities for Tamil TrollMeme Classification. In Proceedings of the Second Workshop on Speech and Language Technologies for Dravidian Languages, pages 51–57, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
hate-alert@DravidianLangTech-ACL2022: Ensembling Multi-Modalities for Tamil TrollMeme Classification (Das et al., DravidianLangTech 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/build-pipeline-with-new-library/2022.dravidianlangtech-1.8.pdf
Video:
 https://preview.aclanthology.org/build-pipeline-with-new-library/2022.dravidianlangtech-1.8.mp4
PDF Search Video Fix metadata