@inproceedings{asai-etal-2023-retrieval,
    title = "Retrieval-based Language Models and Applications",
    author = "Asai, Akari  and
      Min, Sewon  and
      Zhong, Zexuan  and
      Chen, Danqi",
    editor = "Chen, Yun-Nung (Vivian)  and
      Margot, Margot  and
      Reddy, Siva",
    booktitle = "Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 6: Tutorial Abstracts)",
    month = jul,
    year = "2023",
    address = "Toronto, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/landing_page/2023.acl-tutorials.6/",
    doi = "10.18653/v1/2023.acl-tutorials.6",
    pages = "41--46",
    abstract = "Retrieval-based language models (LMs) have shown impressive performance on diverse NLP tasks. In this tutorial, we will provide a comprehensive and coherent overview of recent advances in retrieval-based LMs. We will start by providing preliminaries covering the foundation of LMs (e.g., masked LMs, autoregressive LMs) and retrieval systems (e.g., nearest-neighbor search). We will then detail recent progress in retrieval-based models, focusing on their model architectures and learning approaches. Finally, we will show how retrieval-based LMs are adapted to downstream applications, and extended to multilingual and multi-modal settings. Finally, we will use an exercise to showcase the effectiveness of retrieval-based LMs."
}