A Dataset of Psychiatric Hospital Notes with Temporal Information Annotations
Timothy A. Miller, Gaby Dinh, David Harris, WonJin Yoon, Spencer Thomas, Boyu Ren, Meihua Hall, Guergana Savova
Abstract
Temporal information extraction is the task of identifying temporal entities in a text and relating them to each other. In medicine, electronic health records (EHRs) contain text that documents the sequence of events during an encounter with a patient, and sometimes the events prior to the encounter (e.g., social history). Temporality is especially important for the specialty of psychiatry. In this work, we describe the updates to the guidelines that allowed us to create a corpus of temporally-annotated psychiatric discharge summaries and progress notes. These updated guidelines were used to create a corpus of over 18000 events, 2200 time expressions, and 13,000 temporal relations. Temporal information extraction performance with a baseline system trained on non-psychiatric data obtains an F1 score of 0.152 on relation extraction, indicating the importance of this new dataset for making progress on temporal information extraction in the psychiatric domain.- Anthology ID:
- 2026.lrec-1.592
- Volume:
- Proceedings of the Fifteenth Language Resources and Evaluation Conference
- Month:
- May
- Year:
- 2026
- Address:
- Palma de Mallorca, Spain
- Editors:
- Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
- Venue:
- LREC
- SIG:
- Publisher:
- ELRA Language Resource Association
- Note:
- Pages:
- 7479–7484
- Language:
- External URL:
- https://lrec.elra.info/lrec2026-main-592
- DOI:
- 10.63317/4pj6fbqovg3f
- Cite (ACL):
- Timothy A. Miller, Gaby Dinh, David Harris, WonJin Yoon, Spencer Thomas, Boyu Ren, Meihua Hall, and Guergana Savova. 2026. A Dataset of Psychiatric Hospital Notes with Temporal Information Annotations. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 7479–7484, Palma de Mallorca, Spain. ELRA Language Resource Association.
- Cite (Informal):
- A Dataset of Psychiatric Hospital Notes with Temporal Information Annotations (Miller et al., LREC 2026)