arXiv:2605.13534cs.AI2026-05

多视角并行检索+显式合并,提升大模型推理准确率

Scaling Retrieval-Augmented Reasoning with Parallel Search and Explicit Merging

论文配图:Scaling Retrieval-Augmented Reasoning with Parallel Search and Explicit Merging
图 1 · 摘自论文原文
  • 每步生成多个查询并行检索,扩大信息覆盖范围
  • 通过显式合并提升检索信噪比,减少错误推理步骤
  • 基于强化学习优化检索与融合,适合复杂问答任务

深度搜索代理通过在多步推理中检索外部知识,有效增强了大语言模型的能力。然而,现有方法在每个推理步骤仅生成单一查询进行检索,限制了信息覆盖范围,并引入高噪声,导致检索信噪比低,降低推理准确性并引发不必要的推理步骤。本文提出MultiSearch,一种基于强化学习的框架,通过多查询检索和显式信息合并解决上述问题。在每个推理步骤中,MultiSearch从多个角度生成查询,并行检索外部信息,扩大相关知识的覆盖范围,降低对单一检索结果的依赖。随后,智能体在合并阶段整合并精炼检索到的信息,提升信噪比,确保更准确的推理。此外,我们设计了多过程奖励机制的强化学习框架,同时优化多查询检索与信息融合能力。在七个基准测试上的大量实验表明,MultiSearch优于基线方法,显著提升了检索信噪比,并改善了问答任务中的推理性能。

原文摘要 · Abstract (English)

Deep search agents have proven effective in enhancing LLMs by retrieving external knowledge during multi-step reasoning. However, existing methods often generate a single query for retrieval at each reasoning step, limiting information coverage and introducing high noise. This may result in low signal-to-noise ratios (SNR) during search, degrading reasoning accuracy and leading to unnecessary reasoning steps. In this paper, we introduce MultiSearch, an RL-based framework that addresses these limitations through multi-query retrieval and explicit merging of retrieved information. At each reasoning step, MultiSearch generates queries from multiple perspectives and retrieves external information in parallel, expanding the scope of relevant information and mitigating the reliance on any single retrieval result. Then, the agent consolidates and refines retrieved information at the merging process, improving the SNR and ensuring more accurate reasoning. Additionally, we propose a reinforcement learning framework with a multi-process reward design to optimize agents for both multi-query retrieval and information consolidation. Extensive experiments on seven benchmarks demonstrate that MultiSearch outperforms baseline methods, enhancing the SNR of retrieval and improving reasoning performance in question-answering tasks.

检索增强多查询检索强化学习推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。