BDA at SemEval-2024 Task 4: Detection of Persuasion in Memes Across Languages with Ensemble Learning and External Knowledge
Victoria Sherratt, Sedat Dogan, Ifeoluwa Wuraola, Lydia Bryan-smith, Oyinkansola Onwuchekwa, Nina Dethlefs
Abstract
This paper outlines our multimodal ensemble learning system for identifying persuasion techniques in memes. We contribute an approach which utilises the novel inclusion of consistent named visual entities extracted using Google Vision’s API as an external knowledge source, joined to our multimodal ensemble via late fusion. As well as detailing our experiments in ensemble combinations, fusion methods and data augmentation, we explore the impact of including external data and summarise post-evaluation improvements to our architecture based on analysis of the task results.- Anthology ID:
- 2024.semeval-1.20
- Volume:
- Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
- Month:
- June
- Year:
- 2024
- Address:
- Mexico City, Mexico
- Editors:
- Atul Kr. Ojha, A. Seza Doğruöz, Harish Tayyar Madabushi, Giovanni Da San Martino, Sara Rosenthal, Aiala Rosá
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 123–132
- Language:
- URL:
- https://aclanthology.org/2024.semeval-1.20
- DOI:
- Cite (ACL):
- Victoria Sherratt, Sedat Dogan, Ifeoluwa Wuraola, Lydia Bryan-smith, Oyinkansola Onwuchekwa, and Nina Dethlefs. 2024. BDA at SemEval-2024 Task 4: Detection of Persuasion in Memes Across Languages with Ensemble Learning and External Knowledge. In Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024), pages 123–132, Mexico City, Mexico. Association for Computational Linguistics.
- Cite (Informal):
- BDA at SemEval-2024 Task 4: Detection of Persuasion in Memes Across Languages with Ensemble Learning and External Knowledge (Sherratt et al., SemEval 2024)
- PDF:
- https://preview.aclanthology.org/jeptaln-2024-ingestion/2024.semeval-1.20.pdf