SigJBS@LT-EDI 2026: Multimodal Homophobia and Transphobia Meme Classification
Gaurangi Sinha, Rajarajeswari Palacharla, Manoj Balaji Jagadeeshan
Abstract
This paper presents our system for the LT-EDI@ACL 2026 workshop on meme classification of homophobia and transphobia in English, Hindi, and Chinese. Detecting harmful content in memes is challenging because meaning often emerges from the interaction between visual elements and short textual cues, particularly in multilingual settings. To address this, we build a multimodal pipeline using CLIP ViT-L/14 visual embeddings, EasyOCR text extraction, TF–IDF lexical features, and a multinomial logistic regression classifier. We further incorporate two optional expert modules, a LoRA-adapted Qwen2-VL model and a CLIP zero-shot classifier, and combine predictions using weighted majority voting. The system is intentionally lightweight and reproducible, demonstrating that strong pretrained transfer features paired with explicit OCR can provide robust multilingual meme moderation without extensive fine-tuning. On the official leaderboard, our submission ranks 1st in Hindi, 3rd in English, and 5th in Chinese.- Anthology ID:
- 2026.ltedi-1.28
- Volume:
- Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion
- Month:
- July
- Year:
- 2026
- Address:
- Virtual (Online)
- Editors:
- Bharathi Raja Chakravarthi, Bharathi B, Paul Buitelaar, Durairaj Thenmozhi, Miguel Ángel García Cumbreras, Salud María Jiménez Zafra
- Venues:
- LTEDI | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 226–233
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.ltedi-1.28/
- DOI:
- Cite (ACL):
- Gaurangi Sinha, Rajarajeswari Palacharla, and Manoj Balaji Jagadeeshan. 2026. SigJBS@LT-EDI 2026: Multimodal Homophobia and Transphobia Meme Classification. In Proceedings of the Sixth Workshop on Language Technology for Equality, Diversity, Inclusion, pages 226–233, Virtual (Online). Association for Computational Linguistics.
- Cite (Informal):
- SigJBS@LT-EDI 2026: Multimodal Homophobia and Transphobia Meme Classification (Sinha et al., LTEDI 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.ltedi-1.28.pdf