@inproceedings{teillers-valdenegro-toro-2026-tricking,
    title = "Tricking Open-World Object Recognition Models: Uncertainty in Out-of-Distribution Detection",
    author = "Teillers, Wout  and
      Valdenegro-Toro, Matias",
    editor = "Chen, Canyu  and
      Zhang, Yuji  and
      Li, Zoey Sha  and
      Wang, Zihan  and
      Wang, Qineng  and
      Su, Jinyan  and
      Kargupta, Priyanka  and
      Marjanovi{\'c}, Sara Vera  and
      Pan, Jeff Z.  and
      Bansal, Mohit  and
      Augenstein, Isabelle  and
      Han, Jiawei  and
      Ji, Heng  and
      Li, Manling",
    booktitle = "Proceedings of the 4th Workshop on Towards Knowledgeable Foundation Models ({K}now{FM} 2026)",
    month = jul,
    year = "2026",
    address = "San Diego, California, United States",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-acl-workshops/2026.knowfm-1.12/",
    pages = "147--164",
    ISBN = "979-8-89176-403-3",
    abstract = "Object recognition models are well studied on benchmark datasets, typically focusing on performance in retrieving objects that exist in images. However, in real-life scenarios there is no prior knowledge of an object{'}s existence, and current research fails to assess model performance in these situations. This research aims to shed light on this problem by testing three Open-World models, YOLO-World, Grounding Dino and GPT-4o, on the LVIS, Open Images, and JUS datasets. We design an experiment where models are confronted with impossible prompts by instructing them to retrieve non-existing objects. This allows us to observe the models' uncertainty performance. Overall, GPT-4o performed poorest with regard to object recognition and uncertainty estimation. GPT-4o showed to be highly overconfident. In contrast, YOLO-World and Grounding Dino are slightly underconfident, but they are superior in their uncertainty calibration in comparison to GPT-4o. However, all three models occasionally assign high confident predictions to non-existing objects. Showing that improvement can still be made to the uncertainty estimation of these models when confronted with impossible prompts."
}