让检索与生成统一在同一个推理流程中,自动决定何时查、怎么查。
Retrieval as Generation: A Unified Framework with Self-Triggered Information Planning

- 通过生成控制令牌动态决定检索时机与方式
- 在5个问答数据集上优于主流RAG模型,参数量更少
- 适合需要高效精准检索的对话系统与知识问答场景
我们重新思考检索增强生成(RAG),将检索控制直接嵌入生成过程。不再将检索视为外部干预,而是将其决策表达为逐标记解码的一部分,实现端到端协同,无需额外控制器或分类器。在此框架下,提出GRIP(Generation-guided Retrieval with Information Planning),模型通过发出控制令牌来调节检索行为。核心是自触发信息规划机制,使模型能在单个自回归轨迹中自主决定何时检索、如何重写查询、何时终止。该设计紧密耦合检索与推理,支持动态多步推断与实时证据整合。为监督这些行为,构建了包含可回答、部分可回答及多跳查询的结构化训练集,每类对应该特定的标记模式。在五个QA基准上的实验表明,GRIP超越了强基线RAG模型,并在性能上媲美GPT-4o,但参数量显著更少。
原文摘要 · Abstract (English)
We revisit retrieval-augmented generation (RAG) by embedding retrieval control directly into generation. Instead of treating retrieval as an external intervention, we express retrieval decisions within token-level decoding, enabling end-to-end coordination without additional controllers or classifiers. Under the paradigm of Retrieval as Generation, we propose \textbf{GRIP} (\textbf{G}eneration-guided \textbf{R}etrieval with \textbf{I}nformation \textbf{P}lanning), a unified framework in which the model regulates retrieval behavior through control-token emission. Central to GRIP is \textit{Self-Triggered Information Planning}, which allows the model to decide when to retrieve, how to reformulate queries, and when to terminate, all within a single autoregressive trajectory. This design tightly couples retrieval and reasoning and supports dynamic multi-step inference with on-the-fly evidence integration. To supervise these behaviors, we construct a structured training set covering answerable, partially answerable, and multi-hop queries, each aligned with specific token patterns. Experiments on five QA benchmarks show that GRIP surpasses strong RAG baselines and is competitive with GPT-4o while using substantially fewer parameters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。