From Oral History to Structured Data: The MalachNER Dataset

Christopher Brückner, Karin Roginer Hofmeister, Jiří Kocián, Pavel Pecina


Abstract
We present MalachNER, a new multilingual dataset for Named Entity Recognition (NER) in testimonies of Holocaust survivors. MalachNER has been sourced from different archives and annotated based on comprehensive domain-specific guidelines refined by a collaboration of international experts. Covering 10 European languages, differs significantly from previously released datasets: It is primarily based on noisy, verbatim transcribed speech, rather than on digitized written documents. These transcripts are characterized, among other challenges, by fillers, dialectal speech, and in-line annotations indicating incomprehensible words, which are not commonly encountered in other datasets. However, large volumes of yet unprocessed oral history make such a dataset a necessity. In addition to the description of the dataset and its annotation guidelines, we show with baseline experiments that MalachNER is complementary with previously released data, and the key to training domain-specific language models that generalize well to written and oral testimony alike, achieving state-of-the-art performance on both types of documents.
Anthology ID:
2026.htres-2.7
Volume:
Proceedings of The Second Workshop on Holocaust Testimonies as Language Resources (HTRes)
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Isuri Anuradha, Martin Wynne
Venues:
htres | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
59–65
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-htres-07
DOI:
10.63317/3zyb8y48bdnk
Bibkey:
Cite (ACL):
Christopher Brückner, Karin Roginer Hofmeister, Jiří Kocián, and Pavel Pecina. 2026. From Oral History to Structured Data: The MalachNER Dataset. In Proceedings of The Second Workshop on Holocaust Testimonies as Language Resources (HTRes), pages 59–65, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
From Oral History to Structured Data: The MalachNER Dataset (Brückner et al., htres 2026)
Copy Citation: