Grammar and Meaning: Analysing the Topology of Diachronic Word Embeddings
Yuri Bizzoni, Stefania Degaetano-Ortlieb, Katrin Menzel, Pauline Krielke, Elke Teich
Abstract
The paper showcases the application of word embeddings to change in language use in the domain of science, focusing on the Late Modern English period (17-19th century). Historically, this is the period in which many registers of English developed, including the language of science. Our overarching interest is the linguistic development of scientific writing to a distinctive (group of) register(s). A register is marked not only by the choice of lexical words (discourse domain) but crucially by grammatical choices which indicate style. The focus of the paper is on the latter, tracing words with primarily grammatical functions (function words and some selected, poly-functional word forms) diachronically. To this end, we combine diachronic word embeddings with appropriate visualization and exploratory techniques such as clustering and relative entropy for meaningful aggregation of data and diachronic comparison.- Anthology ID:
- W19-4722
- Volume:
- Proceedings of the 1st International Workshop on Computational Approaches to Historical Language Change
- Month:
- August
- Year:
- 2019
- Address:
- Florence, Italy
- Editors:
- Nina Tahmasebi, Lars Borin, Adam Jatowt, Yang Xu
- Venue:
- LChange
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 175–185
- Language:
- URL:
- https://aclanthology.org/W19-4722
- DOI:
- 10.18653/v1/W19-4722
- Cite (ACL):
- Yuri Bizzoni, Stefania Degaetano-Ortlieb, Katrin Menzel, Pauline Krielke, and Elke Teich. 2019. Grammar and Meaning: Analysing the Topology of Diachronic Word Embeddings. In Proceedings of the 1st International Workshop on Computational Approaches to Historical Language Change, pages 175–185, Florence, Italy. Association for Computational Linguistics.
- Cite (Informal):
- Grammar and Meaning: Analysing the Topology of Diachronic Word Embeddings (Bizzoni et al., LChange 2019)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/W19-4722.pdf