CitiusNLP at SemEval-2020 Task 3: Comparing Two Approaches for Word Vector Contextualization

Pablo Gamallo


Abstract
This article describes some unsupervised strategies submitted to SemEval 2020 Task 3, a task which consists of considering the effect of context to compute word similarity. More precisely, given two words in context, the system must predict the degree of similarity of those words considering the context in which they occur, and the system score is compared against human prediction. We compare one approach based on pre-trained BERT models with other strategy relying on static word embeddings and syntactic dependencies. The BERT-based method clearly outperformed the dependency-based strategy.
Anthology ID:
2020.semeval-1.34
Volume:
Proceedings of the Fourteenth Workshop on Semantic Evaluation
Month:
December
Year:
2020
Address:
Barcelona (online)
Venues:
COLING | SemEval
SIGs:
SIGLEX | SIGSEM
Publisher:
International Committee for Computational Linguistics
Note:
Pages:
275–280
Language:
URL:
https://aclanthology.org/2020.semeval-1.34
DOI:
10.18653/v1/2020.semeval-1.34
Bibkey:
Cite (ACL):
Pablo Gamallo. 2020. CitiusNLP at SemEval-2020 Task 3: Comparing Two Approaches for Word Vector Contextualization. In Proceedings of the Fourteenth Workshop on Semantic Evaluation, pages 275–280, Barcelona (online). International Committee for Computational Linguistics.
Cite (Informal):
CitiusNLP at SemEval-2020 Task 3: Comparing Two Approaches for Word Vector Contextualization (Gamallo, SemEval 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/2020.semeval-1.34.pdf