arXiv:2509.24107cs.AIcs.LG2025-09被引 5

让小模型也能做深度长时信息检索与综合,突破工具调用20次瓶颈。

Fathom-DeepResearch: Unlocking Long Horizon Information Retrieval and Synthesis for SLMs

  • 用多智能体自生成数据+强化学习优化,实现可靠超20步工具调用。
  • 在多个基准上达开源模型最优,支持长时推理和跨任务泛化。
  • 适合需要深度调研的AI应用,如科研、医疗决策支持。

工具集成推理已成为构建智能体应用的关键方向。其中,深度调研智能体在复杂开放信息查询任务中表现突出。我们提出Fathom-DeepResearch,由两个专用模型组成:一是基于Qwen3-4B训练的Fathom-Search-4B,通过实时网络搜索和定向网页查询进行基于证据的调查,其训练融合三项改进:(i) DUETQA,一个5000样本的多智能体自玩生成数据集,强制依赖网络搜索并要求来源多样性;(ii) RAPO,GRPO的零开销扩展,通过课程剪枝、奖励感知优势缩放和每提示词重放缓冲区稳定多轮强化学习;(iii) 可调控的步骤级奖励机制,按认知行为和边际效用分类每次工具调用,实现对搜索广度、深度和时长的显式控制。该机制使工具调用可靠扩展至20次以上。二是基于Qwen3-4B的Fathom-Synthesizer-4B,将多轮深度搜索轨迹转化为结构化、引用密集的深度研究报告,完成综合。在SimpleQA、FRAMES、WebWalker、Seal0、MuSiQue等深度搜索基准及DeepResearch-Bench上评估,系统在开源权重类别中达到领先性能,并展现出对多样化推理任务(如HLE、AIME-25、GPQA-Diamond、MedQA)的强大泛化能力。

原文摘要 · Abstract (English)

Tool-integrated reasoning has emerged as a key focus for enabling agentic applications. Among these, DeepResearch Agents have gained significant attention for their strong performance on complex, open-ended information-seeking tasks. We introduce Fathom-DeepResearch, an agentic system composed of two specialized models. The first is Fathom-Search-4B, a DeepSearch model trained from Qwen3-4B and optimized for evidence-based investigation through live web search and targeted webpage querying. Its training combines three advances: (i) DUETQA, a 5K-sample dataset generated via multi-agent self-play that enforces strict web-search dependence and heterogeneous source grounding; (ii) RAPO, a zero-overhead extension of GRPO that stabilizes multi-turn Reinforcement Learning with Verifiable Rewards through curriculum pruning, reward-aware advantage scaling, and per-prompt replay buffers; and (iii) a steerable step-level reward that classifies each tool call by cognitive behavior and marginal utility, enabling explicit control over search trajectory breadth, depth, and horizon. These improvements enable reliable extension of tool-calling beyond 20 calls when warranted. The second is Fathom-Synthesizer-4B, trained from Qwen3-4B, which converts multi-turn DeepSearch traces into structured, citation-dense DeepResearch Reports for comprehensive synthesis. Evaluated on DeepSearch benchmarks (SimpleQA, FRAMES, WebWalker, Seal0, MuSiQue) and DeepResearch-Bench, the system achieves state-of-the-art performance in the open-weights category while demonstrating strong generalization to diverse reasoning tasks including HLE, AIME-25, GPQA-Diamond, and MedQA.

深度搜索智能体信息综合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。