Abstract
SemEval-2023’s Task 1, Visual Word Sense Disambiguation, a task about text semantics and visual semantics, selecting an image from a list of candidates, that best exhibits a given target word in a small context. We tried several methods, including the image captioning method and CLIP methods, and submitted our predictions in the competition for this task. This paper describes the methods we used and their performance and provides an analysis and discussion of the performance.- Anthology ID:
- 2023.semeval-1.55
- Volume:
- Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 409–414
- Language:
- URL:
- https://aclanthology.org/2023.semeval-1.55
- DOI:
- 10.18653/v1/2023.semeval-1.55
- Cite (ACL):
- Yuchen Wei and Milton King. 2023. StFX NLP at SemEval-2023 Task 1: Multimodal Encoding-based Methods for Visual Word Sense Disambiguation. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 409–414, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- StFX NLP at SemEval-2023 Task 1: Multimodal Encoding-based Methods for Visual Word Sense Disambiguation (Wei & King, SemEval 2023)
- PDF:
- https://preview.aclanthology.org/ingest-bitext-workshop/2023.semeval-1.55.pdf