Normalizing Early English Letters to Present-day English Spelling
Mika Hämäläinen, Tanja Säily, Jack Rueter, Jörg Tiedemann, Eetu Mäkelä
Abstract
This paper presents multiple methods for normalizing the most deviant and infrequent historical spellings in a corpus consisting of personal correspondence from the 15th to the 19th century. The methods include machine translation (neural and statistical), edit distance and rule-based FST. Different normalization methods are compared and evaluated. All of the methods have their own strengths in word normalization. This calls for finding ways of combining the results from these methods to leverage their individual strengths.- Anthology ID:
- W18-4510
- Volume:
- Proceedings of the Second Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature
- Month:
- August
- Year:
- 2018
- Address:
- Santa Fe, New Mexico
- Editors:
- Beatrice Alex, Stefania Degaetano-Ortlieb, Anna Feldman, Anna Kazantseva, Nils Reiter, Stan Szpakowicz
- Venue:
- LaTeCH
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 87–96
- Language:
- URL:
- https://aclanthology.org/W18-4510
- DOI:
- Cite (ACL):
- Mika Hämäläinen, Tanja Säily, Jack Rueter, Jörg Tiedemann, and Eetu Mäkelä. 2018. Normalizing Early English Letters to Present-day English Spelling. In Proceedings of the Second Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature, pages 87–96, Santa Fe, New Mexico. Association for Computational Linguistics.
- Cite (Informal):
- Normalizing Early English Letters to Present-day English Spelling (Hämäläinen et al., LaTeCH 2018)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-1/W18-4510.pdf