_alexcristea@EEUCA 2026: A Robust Early-Fusion ERNIE Pipeline for Multimodal COVID-19 Vaccine Meme Classification

Cristea Alexandru-Marian, Costin Ionescu


Abstract
This paper presents our system for the EEUCA0022026 shared task on Multimodal Vaccine Critical Meme Detection. The task focuses on categorizing social media memes from the VaxMeme dataset into three stances: Vaccine Critical, Neutral, and Pro-Vaccine. To tackle the inherent challenges of internet sarcasm, implicit context, and high label noise, we propose a robust, heavily regularized text-fusion pipeline. Rather than relying on computationally heavy visual encoders, we extract text directly from the images via OCR and concatenate it with the user’s social media post, processing the unified context through an ERNIE 2.0-Large encoder. To combat the severe overfitting typical in subjective meme datasets, we replace the standard classification head with a Multi-Sample Dropout architecture, averaging predictions across five parallel dropout masks (p = 0.3). Our optimized, lightweight text-only pipeline achieves a peak Macro F1 score of 0.834. Furthermore, an ablation study utilizing Focal Loss reveals that our primary solution using standard Cross-Entropy provides superior robustness against the inherent label noise found in internet meme datasets.
Anthology ID:
2026.eeuca-1.20
Volume:
Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ali Hürriyetoğlu, Surendrabikram Thapa, Hristo Tanev
Venues:
EEUCA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
185–191
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.eeuca-1.20/
DOI:
Bibkey:
Cite (ACL):
Cristea Alexandru-Marian and Costin Ionescu. 2026. _alexcristea@EEUCA 2026: A Robust Early-Fusion ERNIE Pipeline for Multimodal COVID-19 Vaccine Meme Classification. In Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026), pages 185–191, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
_alexcristea@EEUCA 2026: A Robust Early-Fusion ERNIE Pipeline for Multimodal COVID-19 Vaccine Meme Classification (Alexandru-Marian & Ionescu, EEUCA 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.eeuca-1.20.pdf