@inproceedings{bueno-etal-2025-testing,
    title = "Testing Spatial Intuitions of Humans and Large Language and Multimodal Models in Analogies",
    author = "Bueno, Ivo  and
      Bavaresco, Anna  and
      Cunha, Jo{\~a}o Miguel  and
      Wicke, Philipp",
    editor = "Rambelli, Giulia  and
      Ilievski, Filip  and
      Bolognesi, Marianna  and
      Sommerauer, Pia",
    booktitle = "Proceedings of the 2nd Workshop on Analogical Abstraction in Cognition, Perception, and Language (Analogy-Angle II)",
    month = aug,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/acl25-workshop-ingestion/2025.analogyangle-1.9/",
    pages = "108--132",
    ISBN = "979-8-89176-274-9",
    abstract = "Language and Vision-Language Models exhibit impressive language capabilities akin to human reasoning. However, unlike humans who acquire language through embodied, interactive experiences, these models learn from static datasets without real-world interaction. This difference raises questions about how they conceptualize abstract notions and whether their reasoning aligns with human cognition. We investigate spatial conceptualizations of LLMs and VLMs by conducting analogy prompting studies with LLMs, VLMs, and human participants. We assess their ability to generate and interpret analogies for spatial concepts. We quantitatively compare the analogies produced by each group, examining the impact of multimodal inputs and reasoning mechanisms. Our findings indicate that generative models can produce and interpret analogies but differ significantly from human reasoning in their abstraction of spatial concepts - variability influenced by input modality, model size, and prompting methods, with analogy-based prompts not consistently enhancing alignment. Contributions include a methodology for probing generative models through analogies; a comparative analysis of analogical reasoning among models, and humans; and insights into the effect of multimodal inputs on reasoning."
}