SemEval-2023 Task 1: Visual Word Sense Disambiguation
Alessandro Raganato, Iacer Calixto, Asahi Ushio, Jose Camacho-Collados, Mohammad Taher Pilehvar
Abstract
This paper presents the Visual Word Sense Disambiguation (Visual-WSD) task.The objective of Visual-WSD is to identify among a set of ten images the one that corresponds to the intended meaning of a given ambiguous word which is accompanied with minimal context. The task provides datasets for three different languages: English, Italian, and Farsi.We received a total of 96 different submissions. Out of these, 40 systems outperformed a strong zero-shot CLIP-based baseline.Participating systems proposed different zero- and few-shot approaches, often involving generative models and data augmentation.More information can be found on the task’s website: \url{https://raganato.github.io/vwsd/}.- Anthology ID:
- 2023.semeval-1.308
- Volume:
- Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2227–2234
- Language:
- URL:
- https://aclanthology.org/2023.semeval-1.308
- DOI:
- 10.18653/v1/2023.semeval-1.308
- Cite (ACL):
- Alessandro Raganato, Iacer Calixto, Asahi Ushio, Jose Camacho-Collados, and Mohammad Taher Pilehvar. 2023. SemEval-2023 Task 1: Visual Word Sense Disambiguation. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 2227–2234, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- SemEval-2023 Task 1: Visual Word Sense Disambiguation (Raganato et al., SemEval 2023)
- PDF:
- https://preview.aclanthology.org/remove-xml-comments/2023.semeval-1.308.pdf