@inproceedings{yu-etal-2025-unleashing,
    title = "Unleashing Multi-Hop Reasoning Potential in Large Language Models through Repetition of Misordered Context",
    author = "Yu, Sangwon  and
      Kim, Ik-hwan  and
      Song, Jongyoon  and
      Lee, Saehyung  and
      Park, Junsung  and
      Yoon, Sungroh",
    editor = "Chiruzzo, Luis  and
      Ritter, Alan  and
      Wang, Lu",
    booktitle = "Findings of the Association for Computational Linguistics: NAACL 2025",
    month = apr,
    year = "2025",
    address = "Albuquerque, New Mexico",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/fix-sig-urls/2025.findings-naacl.360/",
    pages = "6435--6455",
    ISBN = "979-8-89176-195-7",
    abstract = "Multi-hop reasoning, which requires multi-step reasoning based on the supporting documents within a given context, remains challenging for large language models (LLMs). LLMs often struggle to filter out irrelevant documents within the context, and their performance is sensitive to the absolute position of supporting documents within that context. In this paper, we identify an additional challenge: LLMs' performance is also sensitive to the order, relative position, in which the supporting documents are presented. We refer to this as the \textbf{misordered context} problem. To address this issue, based on the theoretical approach, we propose a simple yet effective method called \textbf{co}ntext \textbf{re}petition (\textbf{CoRe}), which involves prompting the model by repeatedly presenting the context. This ensures that certain contiguous reasoning segments within supporting documents are presented in the optimal order, effectively guiding the model{'}s reasoning in the appropriate direction. Applying CoRe, we improve the F1 score by up to 30{\%}p on multi-hop QA tasks and increase accuracy by up to 70{\%}p on a synthetic task. Additionally, CoRe helps mitigate the well-known ``lost-in-the-middle'' problem in LLMs and can be effectively combined with retrieval-based approaches utilizing Chain-of-Thought (CoT) reasoning."
}