From Oral History to Structured Data: The MalachNER Dataset
Christopher Brückner, Karin Roginer Hofmeister, Jiří Kocián, Pavel Pecina
Abstract
We present MalachNER, a new multilingual dataset for Named Entity Recognition (NER) in testimonies of Holocaust survivors. MalachNER has been sourced from different archives and annotated based on comprehensive domain-specific guidelines refined by a collaboration of international experts. Covering 10 European languages, differs significantly from previously released datasets: It is primarily based on noisy, verbatim transcribed speech, rather than on digitized written documents. These transcripts are characterized, among other challenges, by fillers, dialectal speech, and in-line annotations indicating incomprehensible words, which are not commonly encountered in other datasets. However, large volumes of yet unprocessed oral history make such a dataset a necessity. In addition to the description of the dataset and its annotation guidelines, we show with baseline experiments that MalachNER is complementary with previously released data, and the key to training domain-specific language models that generalize well to written and oral testimony alike, achieving state-of-the-art performance on both types of documents.- Anthology ID:
- 2026.htres-2.7
- Volume:
- Proceedings of The Second Workshop on Holocaust Testimonies as Language Resources (HTRes)
- Month:
- May
- Year:
- 2026
- Address:
- Palma, Mallorca (Spain)
- Editors:
- Isuri Anuradha, Martin Wynne
- Venues:
- htres | WS
- SIG:
- Publisher:
- ELRA Language Resources Association (ELRA)
- Note:
- Pages:
- 59–65
- Language:
- External URL:
- https://lrec.elra.info/lrec2026-ws-htres-07
- DOI:
- 10.63317/3zyb8y48bdnk
- Cite (ACL):
- Christopher Brückner, Karin Roginer Hofmeister, Jiří Kocián, and Pavel Pecina. 2026. From Oral History to Structured Data: The MalachNER Dataset. In Proceedings of The Second Workshop on Holocaust Testimonies as Language Resources (HTRes), pages 59–65, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
- Cite (Informal):
- From Oral History to Structured Data: The MalachNER Dataset (Brückner et al., htres 2026)