通过精准边界校准,提升多跳搜索的检索与推理质量。
R$^2$-Searcher: Calibrating Retrieval and Reasoning Boundaries for Agentic Search

- 基于查询词语义细粒度提取事实,引导搜索注意力。
- 每步检索后反思并修正边界,生成更优查询。
- 端到端强化学习优化双边界,实现迭代增强。
近期多跳推理搜索代理常因检索不全或推理无关内容而出现检索-推理边界偏移。本文提出R²-Searcher框架,通过细粒度查询词引导的证据建模与检索后反思机制,显式探索并校准检索与推理边界。具体而言:(1) 基于查询词语义(如主语、动作、时间标记、程度修饰)从检索内容中提取精确事实,构建细粒度推理上下文,引导搜索代理注意力;(2) 引入检索反思机制,在每步检索后评估并修正边界偏差,生成基于提取推理上下文的改进查询;(3) 采用端到端的推理-反思引导强化学习算法R²PO,通过树状推理区域探索与反思联合优化双边界。实验在七个复杂多跳问答基准上表明,R²-Searcher显著优于现有先进方法,在答案准确率和检索-推理质量上均有提升。消融实验进一步验证边界校准的关键作用。
原文摘要 · Abstract (English)
Recent search agents for multi-hop reasoning often fail by either retrieving incomplete evidence or reasoning over irrelevant portions of the retrieved content, leading to a retrieval-reasoning boundary shift. We propose R$^2$-Searcher, a novel framework that explicitly explores and calibrates the retrieval and reasoning boundaries via fine-grained, query-token-guided evidence modeling and post-retrieval reflection. Specifically, R$^2$-Searcher: (1) constructs fine-grained reasoning contexts by extracting precise facts from retrieved content based on query token semantics (e.g., subjects, actions, temporal markers, and degree modifiers), thereby guiding the attention of search agent; (2) introduces a retrieval reflection mechanism that evaluates and corrects boundary deviations after each retrieval step, guiding the generation of improved queries grounded in the extracted reasoning contexts; and (3) employs an end-to-end reasoning-reflection-guided reinforcement learning algorithm, R$^2$PO, which jointly optimizes both boundaries through a tree-based exploration of reasoning regions and reflections. Our method significantly enhances the quality of both retrieval and reasoning, establishing an iterative loop where retrieval and reasoning mutually enhance each other. Extensive experiments on seven complex multi-hop QA benchmarks demonstrate that R$^2$-Searcher significantly outperforms state-of-the-art agentic search methods in answer accuracy and retrieval-reasoning quality. Ablation studies further confirm the critical role of retrieval-reasoning boundary calibration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。