@inproceedings{belz-etal-2025-2025,
    title = "The 2025 {R}epro{NLP} Shared Task on Reproducibility of Evaluations in {NLP}: Overview and Results",
    author = "Belz, Anya  and
      Thomson, Craig  and
      Gonz{\'a}lez Corbelle, Javier  and
      Ruelle, Malo",
    editor = "Dhole, Kaustubh  and
      Clinciu, Miruna",
    booktitle = "Proceedings of the Fourth Workshop on Generation, Evaluation and Metrics (GEM{\texttwosuperior})",
    month = jul,
    year = "2025",
    address = "Vienna, Austria and virtual meeting",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/transition-to-people-yaml/2025.gem-1.78/",
    pages = "1002--1016",
    ISBN = "979-8-89176-261-9",
    abstract = "This paper presents an overview of, and the results from, the 2025 Shared Task on Reproducibility of Evaluations in NLP (ReproNLP{'}25) which followed on from four previous shared tasks on reproducibility of evaluations, ReproNLP{'}24, ReproNLP{'}23, ReproGen{'}22 and ReproGen{'}21. This shared task series forms part of an ongoing research programme designed to develop theory and practice of reproducibility assessment in NLP and machine learning, against a backdrop of increasing recognition of the importance of the topic across the two fields. We describe the ReproNLP{'}25 shared task, summarise results from the reproduction studies submitted, and provide additional comparative analysis of their results, including for the first time additional, `sanity-check' evaluations by LLMs."
}