An evaluation of Named Entity Recognition tools for detecting person names in philosophical text

Ruben Weijers, Jelke Bloem


Abstract
For philosophers, mentions of the names of other philosophers and scientists are an important indicator of relevance and influence. However, they don’t always come in neat citations, especially in older works. We evaluate various approaches to named entity recognition for person names in 20th century, English-language philosophical texts. We use part of a digitized corpus of the works of W.V. Quine, manually annotated for person names, to compare the performance of several systems: the rule-based edhiphy, spaCy’s CNN-based system, FLAIR’s BiLSTM-based system, and SpanBERT, ERNIE-v2 and ModernBERT’s transformer-based approaches. We also experiment with enhancing the smaller models with domain-specific embedding vectors. We find that both spaCy and FLAIR outperform transformer-based models, perhaps due to the small dataset sizes involved.
Anthology ID:
2025.nlp4dh-1.36
Volume:
Proceedings of the 5th International Conference on Natural Language Processing for Digital Humanities
Month:
May
Year:
2025
Address:
Albuquerque, USA
Editors:
Mika Hämäläinen, Emily Öhman, Yuri Bizzoni, So Miyagawa, Khalid Alnajjar
Venues:
NLP4DH | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
418–425
Language:
URL:
https://preview.aclanthology.org/fix-sig-urls/2025.nlp4dh-1.36/
DOI:
Bibkey:
Cite (ACL):
Ruben Weijers and Jelke Bloem. 2025. An evaluation of Named Entity Recognition tools for detecting person names in philosophical text. In Proceedings of the 5th International Conference on Natural Language Processing for Digital Humanities, pages 418–425, Albuquerque, USA. Association for Computational Linguistics.
Cite (Informal):
An evaluation of Named Entity Recognition tools for detecting person names in philosophical text (Weijers & Bloem, NLP4DH 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-sig-urls/2025.nlp4dh-1.36.pdf