arXiv:2508.19113cs.AI2025-08中稿 · ICLR被引 2

提出混合搜索框架,让大模型高效进行多步深度推理。

Hybrid Deep Searcher: Scalable Parallel and Sequential Search Reasoning

  • 结合并行查询扩展与显式证据聚合,提升搜索覆盖
  • 在5个基准上性能超越现有方法,最高提升15.9分F1
  • 支持测试时搜索规模扩展,适合需要深推理的应用

大型推理模型(LRMs)结合检索增强生成(RAG)已实现具备外部知识检索的多步推理研究智能体。然而,现有方法很少展示测试时的搜索可扩展性。通过单查询序列搜索的方法受限于证据覆盖范围,而每步生成多个独立查询的方法则缺乏结构化聚合,阻碍更深层次的序列推理。为此,我们提出一种混合搜索策略,引入HybridDeepSearcher——一个将并行查询扩展与显式证据聚合相结合的结构化搜索代理,在进入更深序列推理前完成整合。为监督该行为,我们构建了新数据集HDS-QA,引导模型通过包含并行子查询的监督推理-查询-检索轨迹,实现广域并行搜索与结构化聚合。在五个基准测试中,HybridDeepSearcher显著优于当前最优方法,在FanOutQA上F1提升+15.9,在BrowseComp的一个子集上提升+9.2。进一步分析显示其具有稳定的测试时搜索扩展能力:随着允许的搜索轮次或调用次数增加,性能持续提升,而竞争方法则趋于饱和。

原文摘要 · Abstract (English)

Large reasoning models (LRMs) combined with retrieval-augmented generation (RAG) have enabled deep research agents capable of multi-step reasoning with external knowledge retrieval. However, we find that existing approaches rarely demonstrate test-time search scaling. Methods that extend reasoning through single-query sequential search suffer from limited evidence coverage, while approaches that generate multiple independent queries per step often lack structured aggregation, hindering deeper sequential reasoning. We propose a hybrid search strategy to address these limitations. We introduce HybridDeepSearcher, a structured search agent that integrates parallel query expansion with explicit evidence aggregation before advancing to deeper sequential reasoning. To supervise this behavior, we introduce HDS-QA, a novel dataset that guides models to combine broad parallel search with structured aggregation through supervised reasoning-query0retrieval trajectories containing parallel sub-queries. Across five benchmarks, HybridDeepSearcher significantly outperforms the state-of-the-art, improving F1 scores by +15.9 on FanOutQA and +9.2 on a subset of BrowseComp. Further analysis shows its consistent test-time search scaling: performance improves as additional search turns or calls are allowed, while competing methods plateau.

大模型推理搜索增强多步推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。