Abstract
Knowing the Most Frequent Sense (MFS) of a word has been proved to help Word Sense Disambiguation (WSD) models significantly. However, the scarcity of sense-annotated data makes it difficult to induce a reliable and high-coverage distribution of the meanings in a language vocabulary. To address this issue, in this paper we present CluBERT, an automatic and multilingual approach for inducing the distributions of word senses from a corpus of raw sentences. Our experiments show that CluBERT learns distributions over English senses that are of higher quality than those extracted by alternative approaches. When used to induce the MFS of a lemma, CluBERT attains state-of-the-art results on the English Word Sense Disambiguation tasks and helps to improve the disambiguation performance of two off-the-shelf WSD models. Moreover, our distributions also prove to be effective in other languages, beating all their alternatives for computing the MFS on the multilingual WSD tasks. We release our sense distributions in five different languages at https://github.com/SapienzaNLP/clubert.- Anthology ID:
- 2020.acl-main.369
- Volume:
- Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
- Month:
- July
- Year:
- 2020
- Address:
- Online
- Editors:
- Dan Jurafsky, Joyce Chai, Natalie Schluter, Joel Tetreault
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 4008–4018
- Language:
- URL:
- https://aclanthology.org/2020.acl-main.369
- DOI:
- 10.18653/v1/2020.acl-main.369
- Cite (ACL):
- Tommaso Pasini, Federico Scozzafava, and Bianca Scarlini. 2020. CluBERT: A Cluster-Based Approach for Learning Sense Distributions in Multiple Languages. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 4008–4018, Online. Association for Computational Linguistics.
- Cite (Informal):
- CluBERT: A Cluster-Based Approach for Learning Sense Distributions in Multiple Languages (Pasini et al., ACL 2020)
- PDF:
- https://preview.aclanthology.org/landing_page/2020.acl-main.369.pdf