UCSC NLP T6 at SemEval-2025 Task 1: Leveraging LLMs and VLMs for Idiomatic Understanding

Judith Clymo, Adam Zernik, Shubham Gaur


Abstract
Idiomatic expressions pose a significant challenge for natural language models due to their non-compositional nature. In this work, we address Subtask 1 of the SemEval-2025 Task 1 (ADMIRE), which requires distinguishing between idiomatic and literal usages of phrases and identify images that align with the relevant meaning.Our approach integrates large language models (LLMs) and vision-language models, and we show how different prompting techniques improve those models’ ability to identify and explain the meaning of idiomatic language.
Anthology ID:
2025.semeval-1.274
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2103–2115
Language:
URL:
https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.274/
DOI:
Bibkey:
Cite (ACL):
Judith Clymo, Adam Zernik, and Shubham Gaur. 2025. UCSC NLP T6 at SemEval-2025 Task 1: Leveraging LLMs and VLMs for Idiomatic Understanding. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 2103–2115, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
UCSC NLP T6 at SemEval-2025 Task 1: Leveraging LLMs and VLMs for Idiomatic Understanding (Clymo et al., SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.274.pdf