Using BERT to Explore Lexical Semantic Change of Prepositions

Liudmila Radchankava


Abstract
This paper presents a semi-supervised approach to investigating lexical semantic change in English prepositions using contextualized word embeddings from BERT. Due to their hybrid lexico-grammatical nature and high degree of polysemy, prepositions have received limited attention in computational studies of semantic change. We address this gap by first applying BERT-based embeddings in combination with a k-nearest neighbors classifier to the task of preposition sense disambiguation, achieving competitive performance without relying on external lexical resources. The trained model is then applied to diachronic data from the Corpus of Historical American English to analyze semantic change over time. By measuring classifier confidence and correlating it with usage year, we detect systematic differences between simple and compound prepositions. Our results confirm linguistic hypotheses that simple prepositions remain largely semantically stable, while compound prepositions exhibit measurable semantic change. The study demonstrates that BERT embeddings provide an effective tool for exploring diachronic semantic phenomena in functionally complex word classes and can be extended to other languages and datasets.
Anthology ID:
2026.lchange-1.10
Volume:
The Proceedings for the 6th International Workshop on Computational Approaches to Language Change (LChange’26)
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Nina Tahmasebi, Pierluigi Cassotti, Syrielle Montariol, Andrey Kutuzov, Netta Huebscher, Elena Spaziani, Naomi Baes
Venue:
LChange
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
124–130
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.lchange-1.10/
DOI:
Bibkey:
Cite (ACL):
Liudmila Radchankava. 2026. Using BERT to Explore Lexical Semantic Change of Prepositions. In The Proceedings for the 6th International Workshop on Computational Approaches to Language Change (LChange’26), pages 124–130, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
Using BERT to Explore Lexical Semantic Change of Prepositions (Radchankava, LChange 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.lchange-1.10.pdf