Normalizing Early English Letters to Present-day English Spelling

Mika Hämäläinen, Tanja Säily, Jack Rueter, Jörg Tiedemann, Eetu Mäkelä


Abstract
This paper presents multiple methods for normalizing the most deviant and infrequent historical spellings in a corpus consisting of personal correspondence from the 15th to the 19th century. The methods include machine translation (neural and statistical), edit distance and rule-based FST. Different normalization methods are compared and evaluated. All of the methods have their own strengths in word normalization. This calls for finding ways of combining the results from these methods to leverage their individual strengths.
Anthology ID:
W18-4510
Volume:
Proceedings of the Second Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature
Month:
August
Year:
2018
Address:
Santa Fe, New Mexico
Editors:
Beatrice Alex, Stefania Degaetano-Ortlieb, Anna Feldman, Anna Kazantseva, Nils Reiter, Stan Szpakowicz
Venue:
LaTeCH
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
87–96
Language:
URL:
https://aclanthology.org/W18-4510
DOI:
Bibkey:
Cite (ACL):
Mika Hämäläinen, Tanja Säily, Jack Rueter, Jörg Tiedemann, and Eetu Mäkelä. 2018. Normalizing Early English Letters to Present-day English Spelling. In Proceedings of the Second Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature, pages 87–96, Santa Fe, New Mexico. Association for Computational Linguistics.
Cite (Informal):
Normalizing Early English Letters to Present-day English Spelling (Hämäläinen et al., LaTeCH 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-1/W18-4510.pdf