A Comparative Study of Static and Contextual Embeddings for Analyzing Semantic Changes in Medieval Latin Charters
Yifan Liu, Gelila Tilahun, Xinxiang Gao, Qianfeng Wen, Michael Gervers
Abstract
The Norman Conquest of 1066 C.E. brought profound transformations to England’s administrative, societal, and linguistic practices. The DEEDS (Documents of Early England Data Set) database offers a unique opportunity to explore these changes by examining shifts in word meanings within a vast collection of Medieval Latin charters. While computational linguistics typically relies on vector representations of words like static and contextual embeddings to analyze semantic changes, existing embeddings for scarce and historical Medieval Latin are limited and may not be well-suited for this task. This paper presents the first computational analysis of semantic change pre- and post-Norman Conquest and the first systematic comparison of static and contextual embeddings in a scarce historical data set. Our findings confirm that, consistent with existing studies, contextual embeddings outperform static word embeddings in capturing semantic change within a scarce historical corpus.- Anthology ID:
- 2025.loreslm-1.14
- Volume:
- Proceedings of the First Workshop on Language Models for Low-Resource Languages
- Month:
- January
- Year:
- 2025
- Address:
- Abu Dhabi, United Arab Emirates
- Editors:
- Hansi Hettiarachchi, Tharindu Ranasinghe, Paul Rayson, Ruslan Mitkov, Mohamed Gaber, Damith Premasiri, Fiona Anting Tan, Lasitha Uyangodage
- Venues:
- LoResLM | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 182–192
- Language:
- URL:
- https://preview.aclanthology.org/corrections-2025-06/2025.loreslm-1.14/
- DOI:
- Cite (ACL):
- Yifan Liu, Gelila Tilahun, Xinxiang Gao, Qianfeng Wen, and Michael Gervers. 2025. A Comparative Study of Static and Contextual Embeddings for Analyzing Semantic Changes in Medieval Latin Charters. In Proceedings of the First Workshop on Language Models for Low-Resource Languages, pages 182–192, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
- Cite (Informal):
- A Comparative Study of Static and Contextual Embeddings for Analyzing Semantic Changes in Medieval Latin Charters (Liu et al., LoResLM 2025)
- PDF:
- https://preview.aclanthology.org/corrections-2025-06/2025.loreslm-1.14.pdf