让大模型自主决定何时、如何检索,提升问答准确性。
Auto-RAG: Autonomous Retrieval-Augmented Generation for Large Language Models
- 大模型自动生成检索策略,无需人工规则或提示。
- 在六个基准上表现优异,自动调节检索轮次适应问题难度。
- 自然语言描述检索过程,结果可解释性强,适合实际应用。
迭代检索是指模型在生成过程中持续向检索器查询,以提高所获知识的相关性,从而提升检索增强生成(RAG)的效果。现有方法通常依赖少量示例提示或手动构建规则实现迭代检索,这增加了推理开销,并忽视了大语言模型(LLMs)强大的推理能力。本文提出Auto-RAG,一种基于大模型强大决策能力的自主迭代检索框架。Auto-RAG与检索器进行多轮对话,系统规划检索并优化查询,直至获取足够外部信息后输出结果。为此,我们开发了一种自动生成基于推理的决策指令的方法,并微调了最新的开源大模型。实验表明,Auto-RAG能自主完成与检索器的迭代交互,有效利用大模型的推理与决策能力,在六个基准测试中表现优异。进一步分析显示,Auto-RAG可依据问题难度和检索知识效用自动调整迭代次数,无需人工干预。此外,其以自然语言表达检索过程,提升了可解释性,为用户提供更直观体验。
原文摘要 · Abstract (English)
Iterative retrieval refers to the process in which the model continuously queries the retriever during generation to enhance the relevance of the retrieved knowledge, thereby improving the performance of Retrieval-Augmented Generation (RAG). Existing work typically employs few-shot prompting or manually constructed rules to implement iterative retrieval. This introduces additional inference overhead and overlooks the remarkable reasoning capabilities of Large Language Models (LLMs). In this paper, we introduce Auto-RAG, an autonomous iterative retrieval model centered on the LLM's powerful decision-making capabilities. Auto-RAG engages in multi-turn dialogues with the retriever, systematically planning retrievals and refining queries to acquire valuable knowledge. This process continues until sufficient external information is gathered, at which point the results are presented to the user. To this end, we develop a method for autonomously synthesizing reasoning-based decision-making instructions in iterative retrieval and fine-tuned the latest open-source LLMs. The experimental results indicate that Auto-RAG is capable of autonomous iterative interaction with the retriever, effectively leveraging the remarkable reasoning and decision-making abilities of LLMs, which lead to outstanding performance across six benchmarks. Further analysis reveals that Auto-RAG can autonomously adjust the number of iterations based on the difficulty of the questions and the utility of the retrieved knowledge, without requiring any human intervention. Moreover, Auto-RAG expresses the iterative retrieval process in natural language, enhancing interpretability while providing users with a more intuitive experience\footnote{Code is available at \url{https://github.com/ictnlp/Auto-RAG}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。