The Interplay of Semantics and Morphology in Word Embeddings

Oded Avraham, Yoav Goldberg


Abstract
We explore the ability of word embeddings to capture both semantic and morphological similarity, as affected by the different types of linguistic properties (surface form, lemma, morphological tag) used to compose the representation of each word. We train several models, where each uses a different subset of these properties to compose its representations. By evaluating the models on semantic and morphological measures, we reveal some useful insights on the relationship between semantics and morphology.
Anthology ID:
E17-2067
Volume:
Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers
Month:
April
Year:
2017
Address:
Valencia, Spain
Editors:
Mirella Lapata, Phil Blunsom, Alexander Koller
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
422–426
Language:
URL:
https://aclanthology.org/E17-2067
DOI:
Bibkey:
Cite (ACL):
Oded Avraham and Yoav Goldberg. 2017. The Interplay of Semantics and Morphology in Word Embeddings. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, pages 422–426, Valencia, Spain. Association for Computational Linguistics.
Cite (Informal):
The Interplay of Semantics and Morphology in Word Embeddings (Avraham & Goldberg, EACL 2017)
Copy Citation:
PDF:
https://preview.aclanthology.org/ml4al-ingestion/E17-2067.pdf
Code
 oavraham1/prop2vec