A graph-based analysis of semantic types and coercion in contextualized word embeddings

Long Chen, Deniz Yavas


Abstract
Semantic type mismatch between a noun and its context is central to coercion phenomena. This paper introduces a graph-based method to examine how lexical and contextual type information is reflected in word embeddings. We select nouns from ten semantic types, annotate corpus instances for type matching (matching vs. coercion vs. other mismatch vs. unrestricted), and construct graphs using BERT and sense-enhanced embeddings. Two metrics—Neighbor Type Probability (NTP) and Neighbor Type Entropy (NTE)—are proposed to analyze neighborhood type distributions. Results show that graphs constructed with sense-enhanced embeddings reflect semantic type information better, and matching and mismatch sentences can be distinguished through the proposed metrics.
Anthology ID:
2026.brigap-1.13
Volume:
Proceedings of the Third Workshop on the Bridges and Gaps between Formal and Computational Linguistics (BriGap-3)
Month:
July
Year:
2026
Address:
Paris, France
Editors:
Timothée Bernard, Emmanuele Chersoni, Giulia Rambelli
Venues:
BriGap | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
148–159
Language:
URL:
https://preview.aclanthology.org/ingest-brigap/2026.brigap-1.13/
DOI:
Bibkey:
Cite (ACL):
Long Chen and Deniz Yavas. 2026. A graph-based analysis of semantic types and coercion in contextualized word embeddings. In Proceedings of the Third Workshop on the Bridges and Gaps between Formal and Computational Linguistics (BriGap-3), pages 148–159, Paris, France. Association for Computational Linguistics.
Cite (Informal):
A graph-based analysis of semantic types and coercion in contextualized word embeddings (Chen & Yavas, BriGap 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-brigap/2026.brigap-1.13.pdf