浅谈大模型时代下的检索增强:发展趋势、挑战与展望(Enhancing Large Language Models with Retrieval-Augmented Techniques: Trends, Challenges, and Prospects)
Feng Zhangyin (冯掌印), Zhu Kun (朱坤), Ma Weitao (马伟涛), Huang Lei (黄磊), Qin Bing (秦兵), Liu Ting (刘挺), Feng Xiaocheng (冯骁骋)
Abstract
“大型语言模型(LLM) 在各种自然语言任务上表现出了卓越的性能,但它们很容易受到过时数据和特定领域限制的影响。为了应对这些挑战,研究人员整合不同来源的外部信息来增强大语言模型,具体方法如检索增强等。在本文中,我们综合讨论了检索增强技术的发展趋势,包括检索时机规划、检索技术、以及检索结果的利用。此外,我们介绍了当前可用于检索增强任务的数据集和评价方法,并指出了应用和潜在研究方向。我们希望这项综述能够为社区提供对该研究领域的快速了解和全面概述,以启发未来的研究工作。”- Anthology ID:
- 2024.ccl-2.9
- Volume:
- Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 2: Frontier Forum)
- Month:
- July
- Year:
- 2024
- Address:
- Taiyuan, China
- Editor:
- Xin Zhao
- Venue:
- CCL
- SIG:
- Publisher:
- Chinese Information Processing Society of China
- Note:
- Pages:
- 151–168
- Language:
- Chinese
- URL:
- https://preview.aclanthology.org/fix-sig-urls/2024.ccl-2.9/
- DOI:
- Cite (ACL):
- Feng Zhangyin, Zhu Kun, Ma Weitao, Huang Lei, Qin Bing, Liu Ting, and Feng Xiaocheng. 2024. 浅谈大模型时代下的检索增强:发展趋势、挑战与展望(Enhancing Large Language Models with Retrieval-Augmented Techniques: Trends, Challenges, and Prospects). In Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 2: Frontier Forum), pages 151–168, Taiyuan, China. Chinese Information Processing Society of China.
- Cite (Informal):
- 浅谈大模型时代下的检索增强:发展趋势、挑战与展望(Enhancing Large Language Models with Retrieval-Augmented Techniques: Trends, Challenges, and Prospects) (Zhangyin et al., CCL 2024)
- PDF:
- https://preview.aclanthology.org/fix-sig-urls/2024.ccl-2.9.pdf