Abstract
In this work, we carry out two experiments in order to assess the ability of BERT to capture the meaning shift associated with metonymic expressions. We test the model on a new dataset that is representative of the most common types of metonymy. We compare BERT with the Structured Distributional Model (SDM), a model for the representation of words in context which is based on the notion of Generalized Event Knowledge. The results reveal that, while BERT ability to deal with metonymy is quite limited, SDM is good at predicting the meaning of metonymic expressions, providing support for an account of metonymy based on event knowledge.- Anthology ID:
- 2020.coling-main.602
- Volume:
- Proceedings of the 28th International Conference on Computational Linguistics
- Month:
- December
- Year:
- 2020
- Address:
- Barcelona, Spain (Online)
- Editors:
- Donia Scott, Nuria Bel, Chengqing Zong
- Venue:
- COLING
- SIG:
- Publisher:
- International Committee on Computational Linguistics
- Note:
- Pages:
- 6831–6837
- Language:
- URL:
- https://aclanthology.org/2020.coling-main.602
- DOI:
- 10.18653/v1/2020.coling-main.602
- Cite (ACL):
- Paolo Pedinotti and Alessandro Lenci. 2020. Don’t Invite BERT to Drink a Bottle: Modeling the Interpretation of Metonymies Using BERT and Distributional Representations. In Proceedings of the 28th International Conference on Computational Linguistics, pages 6831–6837, Barcelona, Spain (Online). International Committee on Computational Linguistics.
- Cite (Informal):
- Don’t Invite BERT to Drink a Bottle: Modeling the Interpretation of Metonymies Using BERT and Distributional Representations (Pedinotti & Lenci, COLING 2020)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-2/2020.coling-main.602.pdf