Abstract
We describe our system for the SemEval 2022 task on detecting misogynous content in memes. This is a pressing problem and we explore various methods ranging from traditional machine learning to deep learning models such as multimodal transformers. We propose a multimodal BERT architecture that uses information from both image and text. We further incorporate common world knowledge from pretrained CLIP and Urban dictionary. We also provide qualitative analysis to support out model. Our best performing model achieves an F1 score of 0.679 on Task A (Rank 5) and 0.680 on Task B (Rank 13) of the hidden test set. Our code is available at https://github.com/paridhimaheshwari2708/MAMI.- Anthology ID:
- 2022.semeval-1.88
- Volume:
- Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022)
- Month:
- July
- Year:
- 2022
- Address:
- Seattle, United States
- Editors:
- Guy Emerson, Natalie Schluter, Gabriel Stanovsky, Ritesh Kumar, Alexis Palmer, Nathan Schneider, Siddharth Singh, Shyam Ratan
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 642–647
- Language:
- URL:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2022.semeval-1.88/
- DOI:
- 10.18653/v1/2022.semeval-1.88
- Cite (ACL):
- Paridhi Maheshwari and Sharmila Reddy Nangi. 2022. TeamOtter at SemEval-2022 Task 5: Detecting Misogynistic Content in Multimodal Memes. In Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022), pages 642–647, Seattle, United States. Association for Computational Linguistics.
- Cite (Informal):
- TeamOtter at SemEval-2022 Task 5: Detecting Misogynistic Content in Multimodal Memes (Maheshwari & Nangi, SemEval 2022)
- PDF:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2022.semeval-1.88.pdf
- Code
- paridhimaheshwari2708/mami