On the Compositionality Prediction of Noun Phrases using Poincaré Embeddings
Abhik Jana, Dima Puzyrev, Alexander Panchenko, Pawan Goyal, Chris Biemann, Animesh Mukherjee
Abstract
The compositionality degree of multiword expressions indicates to what extent the meaning of a phrase can be derived from the meaning of its constituents and their grammatical relations. Prediction of (non)-compositionality is a task that has been frequently addressed with distributional semantic models. We introduce a novel technique to blend hierarchical information with distributional information for predicting compositionality. In particular, we use hypernymy information of the multiword and its constituents encoded in the form of the recently introduced Poincaré embeddings in addition to the distributional information to detect compositionality for noun phrases. Using a weighted average of the distributional similarity and a Poincaré similarity function, we obtain consistent and substantial, statistically significant improvement across three gold standard datasets over state-of-the-art models based on distributional information only. Unlike traditional approaches that solely use an unsupervised setting, we have also framed the problem as a supervised task, obtaining comparable improvements. Further, we publicly release our Poincaré embeddings, which are trained on the output of handcrafted lexical-syntactic patterns on a large corpus.- Anthology ID:
- P19-1316
- Volume:
- Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
- Month:
- July
- Year:
- 2019
- Address:
- Florence, Italy
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 3263–3274
- Language:
- URL:
- https://aclanthology.org/P19-1316
- DOI:
- 10.18653/v1/P19-1316
- Cite (ACL):
- Abhik Jana, Dima Puzyrev, Alexander Panchenko, Pawan Goyal, Chris Biemann, and Animesh Mukherjee. 2019. On the Compositionality Prediction of Noun Phrases using Poincaré Embeddings. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3263–3274, Florence, Italy. Association for Computational Linguistics.
- Cite (Informal):
- On the Compositionality Prediction of Noun Phrases using Poincaré Embeddings (Jana et al., ACL 2019)
- PDF:
- https://preview.aclanthology.org/nodalida-main-page/P19-1316.pdf
- Data
- ConceptNet