@inproceedings{cerini-etal-2024-representing,
    title = "Representing Abstract Concepts with Images: An Investigation with Large Language Models",
    author = "Cerini, Ludovica  and
      Bondielli, Alessandro  and
      Lenci, Alessandro",
    editor = "Zock, Michael  and
      Chersoni, Emmanuele  and
      Hsu, Yu-Yin  and
      de Deyne, Simon",
    booktitle = "Proceedings of the Workshop on Cognitive Aspects of the Lexicon @ LREC-COLING 2024",
    month = may,
    year = "2024",
    address = "Torino, Italia",
    publisher = "ELRA and ICCL",
    url = "https://preview.aclanthology.org/fix-sig-urls/2024.cogalex-1.12/",
    pages = "107--113",
    abstract = "Multimodal metaphorical interpretation of abstract concepts has always been a debated problem in many research fields, including cognitive linguistics and NLP. With the dramatic improvements of Large Language Models (LLMs) and the increasing attention toward multimodal Vision-Language Models (VLMs), there has been pronounced attention on the conceptualization of abstracts. Nevertheless, a systematic scientific investigation is still lacking. This work introduces a framework designed to shed light on the indirect grounding mechanisms that anchor the meaning of abstract concepts to concrete situations (e.g. ability - a person skating), following the idea that abstracts acquire meaning from embodied and situated simulation. We assessed human and LLMs performances by a situation generation task. Moreover, we assess the figurative richness of images depicting concrete scenarios, via a text-to-image retrieval task performed on LAION-400M."
}