@inproceedings{wei-etal-2025-ji2s,
    title = "{J}$I^2${S}: Joint {I}nfluence{-}{A}ware Instruction Data Selection for Efficient {F}ine{-}{T}uning",
    author = "Wei, Jingyu  and
      Liu, Bo  and
      Wan, Tianjiao  and
      Peng, Baoyun  and
      Ma, Xingkong  and
      Guo, Mengmeng",
    editor = "Christodoulopoulos, Christos  and
      Chakraborty, Tanmoy  and
      Rose, Carolyn  and
      Peng, Violet",
    booktitle = "Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing",
    month = nov,
    year = "2025",
    address = "Suzhou, China",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-main.26/",
    pages = "514--527",
    ISBN = "979-8-89176-332-6",
    abstract = "Instruction tuning (IT) improves large language models (LLMs) by aligning their outputs with human instructions, but its success depends critically on training data quality, and datasets such as Alpaca often contain noisy or suboptimal examples that undermine fine{-}tuning. Prior selection strategies score samples using general{-}purpose LLMs (e.g., GPT), leveraging their strong language understanding yet introducing inherent biases that misalign with the target model{'}s behavior and yield unstable downstream performance. Influence{-}based methods address this by estimating each example{'}s marginal contribution to overall performance, but they typically assume additive contributions and therefore overlook higher{-}order interactions among samples. To overcome these limitations, we propose J$\text{I}^2$S, a novel framework that jointly models both marginal and combinatorial influences within sample groups. Applying J$\text{I}^2$S to select the top 1,000 most influential examples from Alpaca, we fine{-}tune LLaMA2{-}7B, Mistral{-}7B, and LLaMA2{-}13B and evaluate them on Open LLM Benchmarks, MT{-}Bench, and GPT{-}4{--}judged pairwise comparisons. Our experiments show that J$\text{I}^2$S consistently outperforms full{-}dataset training and strong baselines, highlighting the value of capturing joint influence for high{-}quality instruction fine{-}tuning. We provide our code in this GitHub repository."
}