Abstract
In recent years, there has been an upsurge in a new form of entertainment medium called memes. These memes although seemingly innocuous have transcended the boundary of online harassment against women and created an unwanted bias against them. To help alleviate this problem, we propose an early fusion model for the prediction and identification of misogynistic memes and their type in this paper for which we participated in SemEval-2022 Task 5. The model receives as input meme image with its text transcription with a target vector. Given that a key challenge with this task is the combination of different modalities to predict misogyny, our model relies on pre-trained contextual representations from different state-of-the-art transformer-based language models and pre-trained image models to get an effective image representation. Our model achieved competitive results on both SubTask-A and SubTask-B with the other competingteams and significantly outperforms the baselines.- Anthology ID:
- 2022.semeval-1.110
- Volume:
- Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022)
- Month:
- July
- Year:
- 2022
- Address:
- Seattle, United States
- Editors:
- Guy Emerson, Natalie Schluter, Gabriel Stanovsky, Ritesh Kumar, Alexis Palmer, Nathan Schneider, Siddharth Singh, Shyam Ratan
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 793–801
- Language:
- URL:
- https://aclanthology.org/2022.semeval-1.110
- DOI:
- 10.18653/v1/2022.semeval-1.110
- Cite (ACL):
- Harshvardhan Srivastava. 2022. Poirot at SemEval-2022 Task 5: Leveraging Graph Network for Misogynistic Meme Detection. In Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022), pages 793–801, Seattle, United States. Association for Computational Linguistics.
- Cite (Informal):
- Poirot at SemEval-2022 Task 5: Leveraging Graph Network for Misogynistic Meme Detection (Srivastava, SemEval 2022)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-2/2022.semeval-1.110.pdf
- Data
- Hateful Memes