Hierarchical Embeddings for Hypernymy Detection and Directionality
Kim Anh Nguyen, Maximilian Köper, Sabine Schulte im Walde, Ngoc Thang Vu
Abstract
We present a novel neural model HyperVec to learn hierarchical embeddings for hypernymy detection and directionality. While previous embeddings have shown limitations on prototypical hypernyms, HyperVec represents an unsupervised measure where embeddings are learned in a specific order and capture the hypernym–hyponym distributional hierarchy. Moreover, our model is able to generalize over unseen hypernymy pairs, when using only small sets of training data, and by mapping to other languages. Results on benchmark datasets show that HyperVec outperforms both state-of-the-art unsupervised measures and embedding models on hypernymy detection and directionality, and on predicting graded lexical entailment.- Anthology ID:
- D17-1022
- Volume:
- Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing
- Month:
- September
- Year:
- 2017
- Address:
- Copenhagen, Denmark
- Editors:
- Martha Palmer, Rebecca Hwa, Sebastian Riedel
- Venue:
- EMNLP
- SIG:
- SIGDAT
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 233–243
- Language:
- URL:
- https://aclanthology.org/D17-1022
- DOI:
- 10.18653/v1/D17-1022
- Cite (ACL):
- Kim Anh Nguyen, Maximilian Köper, Sabine Schulte im Walde, and Ngoc Thang Vu. 2017. Hierarchical Embeddings for Hypernymy Detection and Directionality. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 233–243, Copenhagen, Denmark. Association for Computational Linguistics.
- Cite (Informal):
- Hierarchical Embeddings for Hypernymy Detection and Directionality (Nguyen et al., EMNLP 2017)
- PDF:
- https://preview.aclanthology.org/emnlp22-frontmatter/D17-1022.pdf
- Data
- EVALution, HyperLex