Modeling the Evolution of English Noun Compounds with Feature-Rich Diachronic Compositionality Prediction

Filip Miletić, Sabine Schulte Im Walde


Abstract
We analyze the evolution of English noun compounds, which we represent as vectors of time-specific values. We implement a wide array of methods to create a rich set of features, using them to classify compounds for present-day compositionality and to assess the informativeness of the corresponding linguistic patterns. Our best results use BERT – reflecting the similarity of compounds and sentence contexts – and we further capture relevant and complementary information across approaches. Leveraging these feature differences, we find that the development of low-compositional meanings is reflected by a parallel drop in compositionality and sustained semantic change. The same distinction is echoed in transformer processing: compositionality estimates require far less contextualization than semantic change estimates.
Anthology ID:
2025.acl-long.984
Volume:
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
20071–20092
Language:
URL:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.984/
DOI:
Bibkey:
Cite (ACL):
Filip Miletić and Sabine Schulte Im Walde. 2025. Modeling the Evolution of English Noun Compounds with Feature-Rich Diachronic Compositionality Prediction. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 20071–20092, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Modeling the Evolution of English Noun Compounds with Feature-Rich Diachronic Compositionality Prediction (Miletić & Schulte Im Walde, ACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.984.pdf