You Shall Know a Construction by the Company it Keeps: Computational Construction Grammar with Embeddings

Lara Verheyen, Jonas Doumen, Paul Van Eecke, Katrien Beuls


Abstract
Linguistic theories and models of natural language can be divided into two categories, depending on whether they represent and process linguistic information numerically or symbolically. Numerical representations, such as the embeddings that are at the core of today’s large language models, have the advantage of being learnable from textual data, and of being robust and highly scalable. Symbolic representations, like the ones that are commonly used to formalise construction grammar theories, have the advantage of being compositional and interpretable, and of supporting sound logic reasoning. While both approaches build on very different mathematical frameworks, there is no reason to believe that they are incompatible. In the present paper, we explore how numerical, in casu distributional, representations of linguistic forms, constructional slots and grammatical categories can be integrated in a computational construction grammar framework, with the goal of reaping the benefits of both symbolic and numerical methods.
Anthology ID:
2025.cxgsnlp-1.8
Volume:
Proceedings of the Second International Workshop on Construction Grammars and NLP
Month:
September
Year:
2025
Address:
Düsseldorf, Germany
Editors:
Claire Bonial, Melissa Torgbi, Leonie Weissweiler, Austin Blodgett, Katrien Beuls, Paul Van Eecke, Harish Tayyar Madabushi
Venues:
CxGsNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
75–83
Language:
URL:
https://preview.aclanthology.org/iwcs-25-ingestion/2025.cxgsnlp-1.8/
DOI:
Bibkey:
Cite (ACL):
Lara Verheyen, Jonas Doumen, Paul Van Eecke, and Katrien Beuls. 2025. You Shall Know a Construction by the Company it Keeps: Computational Construction Grammar with Embeddings. In Proceedings of the Second International Workshop on Construction Grammars and NLP, pages 75–83, Düsseldorf, Germany. Association for Computational Linguistics.
Cite (Informal):
You Shall Know a Construction by the Company it Keeps: Computational Construction Grammar with Embeddings (Verheyen et al., CxGsNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/iwcs-25-ingestion/2025.cxgsnlp-1.8.pdf