@inproceedings{lu-etal-2025-multiconir,
    title = "{M}ulti{C}on{IR}: Towards Multi-Condition Information Retrieval",
    author = "Lu, Xuan  and
      Liu, Sifan  and
      Yin, Bochao  and
      Li, Yongqi  and
      Chen, Xinghao  and
      Su, Hui  and
      Jin, Yaohui  and
      Zeng, Wenjun  and
      Shen, Xiaoyu",
    editor = "Christodoulopoulos, Christos  and
      Chakraborty, Tanmoy  and
      Rose, Carolyn  and
      Peng, Violet",
    booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2025",
    month = nov,
    year = "2025",
    address = "Suzhou, China",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/name-variant-enfa-fane/2025.findings-emnlp.726/",
    doi = "10.18653/v1/2025.findings-emnlp.726",
    pages = "13471--13494",
    ISBN = "979-8-89176-335-7",
    abstract = "Multi-condition information retrieval (IR) presents a significant, yet underexplored challenge for existing systems. This paper introduces MultiConIR, the first benchmark specifically designed to evaluate retrieval and reranking models under nuanced multi-condition query scenarios across five diverse domains. We systematically assess model capabilities through three critical tasks: complexity robustness, relevance monotonicity, and query format sensitivity. Our extensive experiments on 15 models reveal a critical vulnerability: most retrievers and rerankers exhibit severe performance degradation as query complexity increases. Key deficiencies include widespread failure to maintain relevance monotonicity, and high sensitivity to query style and condition placement. The superior performance GPT-4o reveals the performance gap between IR systems and advanced LLM for handling sophisticated natural language queries. Furthermore, this work delves into the factors contributing to reranker performance deterioration and examines how condition positioning within queries affects similarity assessment, providing crucial insights for advancing IR systems towards complex search scenarios."
}