Using Multimodal Models for Informative Classification of Ambiguous Tweets in Crisis Response

Sumiko Teng, Emily Öhman


Abstract
Social media platforms like X provide real-time information during crises but often include noisy, ambiguous data, complicating analysis. This study examines the effectiveness of multimodal models, particularly a cross-attention-based approach, in classifying tweets about the California wildfires as “informative” or “uninformative,” leveraging both text and image modalities. Using a dataset containing both ambiguous and unambiguous tweets, models were evaluated for their ability to handle real-world noisy data. Results show that the multimodal model outperforms unimodal counterparts, especially for ambiguous tweets, demonstrating its resilience and ability to integrate complementary modalities. These findings highlight the potential of multimodal approaches to enhance humanitarian response efforts by reducing information overload.
Anthology ID:
2025.nlp4dh-1.23
Volume:
Proceedings of the 5th International Conference on Natural Language Processing for Digital Humanities
Month:
May
Year:
2025
Address:
Albuquerque, USA
Editors:
Mika Hämäläinen, Emily Öhman, Yuri Bizzoni, So Miyagawa, Khalid Alnajjar
Venues:
NLP4DH | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
265–271
Language:
URL:
https://preview.aclanthology.org/corrections-2025-06/2025.nlp4dh-1.23/
DOI:
10.18653/v1/2025.nlp4dh-1.23
Bibkey:
Cite (ACL):
Sumiko Teng and Emily Öhman. 2025. Using Multimodal Models for Informative Classification of Ambiguous Tweets in Crisis Response. In Proceedings of the 5th International Conference on Natural Language Processing for Digital Humanities, pages 265–271, Albuquerque, USA. Association for Computational Linguistics.
Cite (Informal):
Using Multimodal Models for Informative Classification of Ambiguous Tweets in Crisis Response (Teng & Öhman, NLP4DH 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2025-06/2025.nlp4dh-1.23.pdf