@inproceedings{rodriguez-etal-2025-characterizing,
    title = "Characterizing the Role of Similarity in the Property Inferences of Language Models",
    author = "Rodriguez, Juan Diego  and
      Mueller, Aaron  and
      Misra, Kanishka",
    editor = "Chiruzzo, Luis  and
      Ritter, Alan  and
      Wang, Lu",
    booktitle = "Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)",
    month = apr,
    year = "2025",
    address = "Albuquerque, New Mexico",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/fix-sig-urls/2025.naacl-long.574/",
    pages = "11515--11533",
    ISBN = "979-8-89176-189-6",
    abstract = "Property inheritance{---}a phenomenon where novel properties are projected from higher level categories (e.g., birds) to lower level ones (e.g., sparrows){---}provides a unique window into how humans organize and deploy conceptual knowledge. It is debated whether this ability arises due to explicitly stored taxonomic knowledge vs. simple computations of similarity between mental representations. How are these mechanistic hypotheses manifested in contemporary language models? In this work, we investigate how LMs perform property inheritance with behavioral and causal representational analysis experiments. We find that taxonomy and categorical similarities are not mutually exclusive in LMs' property inheritance behavior. That is, LMs are more likely to project novel properties from one category to the other when they are taxonomically related and at the same time, highly similar. Our findings provide insight into the conceptual structure of language models and may suggest new psycholinguistic experiments for human subjects."
}