CrisiText: A dataset of warning messages for LLM training in emergency communication

Giacomo Gonella, Gian Maria Campedelli, Stefano Menini, Marco Guerini


Abstract
Effectively identifying threats and mitigating their potential damage during crisis situations, such as natural disasters or violent attacks, is paramount for safeguarding endangered individuals. To tackle these challenges, AI has been used to assist humans in emergency situations. Still, the use of NLP techniques remains limited and mostly focuses on classification tasks. The significant potential of timely warning message generation using NLG architectures, however, has been largely overlooked. In this paper, we present *CrisiText*, the first large-scale dataset for the generation of warning messages across 13 different types of crisis scenarios. The dataset contains more than 400,000 warning messages (spanning almost 18,000 crisis situations) aimed at assisting civilians during and after such events. To generate the dataset, we started from existing crisis descriptions and created chains of events related to the scenarios. Each event was then paired with a warning message. The generations follow expert’s written guidelines to ensure correct terminology and factuality of their suggestions. Additionally, each message is accompanied by three suboptimal variants to allow for the study of different NLG approaches. To this end, we conducted a series of experiments comparing supervised fine-tuning setups with preference alignment, zero-shot, and few-shot approaches. We further assessed model performance in out-of-distribution scenarios and evaluated the effectiveness of an automatic post-editor.
Anthology ID:
2026.findings-eacl.350
Volume:
Findings of the Association for Computational Linguistics: EACL 2026
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6657–6677
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.findings-eacl.350/
DOI:
Bibkey:
Cite (ACL):
Giacomo Gonella, Gian Maria Campedelli, Stefano Menini, and Marco Guerini. 2026. CrisiText: A dataset of warning messages for LLM training in emergency communication. In Findings of the Association for Computational Linguistics: EACL 2026, pages 6657–6677, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
CrisiText: A dataset of warning messages for LLM training in emergency communication (Gonella et al., Findings 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.findings-eacl.350.pdf
Checklist:
 2026.findings-eacl.350.checklist.pdf