SigJBS@LT-EDI 2026: Multimodal Homophobia and Transphobia Meme Classification

Gaurangi Sinha, Rajarajeswari Palacharla, Manoj Balaji Jagadeeshan


Abstract
This paper presents our system for the LT-EDI@ACL 2026 workshop on meme classification of homophobia and transphobia in English, Hindi, and Chinese. Detecting harmful content in memes is challenging because meaning often emerges from the interaction between visual elements and short textual cues, particularly in multilingual settings. To address this, we build a multimodal pipeline using CLIP ViT-L/14 visual embeddings, EasyOCR text extraction, TF–IDF lexical features, and a multinomial logistic regression classifier. We further incorporate two optional expert modules, a LoRA-adapted Qwen2-VL model and a CLIP zero-shot classifier, and combine predictions using weighted majority voting. The system is intentionally lightweight and reproducible, demonstrating that strong pretrained transfer features paired with explicit OCR can provide robust multilingual meme moderation without extensive fine-tuning. On the official leaderboard, our submission ranks 1st in Hindi, 3rd in English, and 5th in Chinese.
Anthology ID:
2026.ltedi-1.28
Volume:
Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion
Month:
July
Year:
2026
Address:
Virtual (Online)
Editors:
Bharathi Raja Chakravarthi, Bharathi B, Paul Buitelaar, Durairaj Thenmozhi, Miguel Ángel García Cumbreras, Salud María Jiménez Zafra
Venues:
LTEDI | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
226–233
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.ltedi-1.28/
DOI:
Bibkey:
Cite (ACL):
Gaurangi Sinha, Rajarajeswari Palacharla, and Manoj Balaji Jagadeeshan. 2026. SigJBS@LT-EDI 2026: Multimodal Homophobia and Transphobia Meme Classification. In Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion, pages 226–233, Virtual (Online). Association for Computational Linguistics.
Cite (Informal):
SigJBS@LT-EDI 2026: Multimodal Homophobia and Transphobia Meme Classification (Sinha et al., LTEDI 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.ltedi-1.28.pdf