Abstract
Neural Word Sense Disambiguation (WSD) has recently been shown to benefit from the incorporation of pre-existing knowledge, such as that coming from the WordNet graph. However, state-of-the-art approaches have been successful in exploiting only the local structure of the graph, with only close neighbors of a given synset influencing the prediction. In this work, we improve a classification model by recomputing logits as a function of both the vanilla independently produced logits and the global WordNet graph. We achieve this by incorporating an online neural approximated PageRank, which enables us to refine edge weights as well. This method exploits the global graph structure while keeping space requirements linear in the number of edges. We obtain strong improvements, matching the current state of the art. Code is available at https://github.com/SapienzaNLP/neural-pagerank-wsd- Anthology ID:
- 2021.emnlp-main.715
- Volume:
- Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
- Month:
- November
- Year:
- 2021
- Address:
- Online and Punta Cana, Dominican Republic
- Editors:
- Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 9092–9098
- Language:
- URL:
- https://aclanthology.org/2021.emnlp-main.715
- DOI:
- 10.18653/v1/2021.emnlp-main.715
- Cite (ACL):
- Ahmed El Sheikh, Michele Bevilacqua, and Roberto Navigli. 2021. Integrating Personalized PageRank into Neural Word Sense Disambiguation. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 9092–9098, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
- Cite (Informal):
- Integrating Personalized PageRank into Neural Word Sense Disambiguation (El Sheikh et al., EMNLP 2021)
- PDF:
- https://preview.aclanthology.org/naacl24-info/2021.emnlp-main.715.pdf
- Code
- sapienzanlp/neural-pagerank-wsd
- Data
- Word Sense Disambiguation: a Unified Evaluation Framework and Empirical Comparison