让大模型学会合理分派任务,提升长周期研究能力。
SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Research

- 设计任务引导框架,训练模型正确拆解与委派复杂任务。
- 在两个基准测试中分别取得68.1和73.3的最优成绩。
- 适合对智能代理、长程推理感兴趣的开发者与研究者。
大语言模型被期望处理复杂、长周期的真实任务,但其上下文窗口有限。现有方法让主代理分解任务并派遣子任务给子代理,仅接收摘要结果以节省上下文。然而,高效执行需具备委派智能:准确拆解任务、判断何时何事委派、整合返回结果。自然文本中缺乏此类训练数据,开源社区尚未探索合成数据与模型训练方法。为此,本文针对深度研究这一典型长周期任务,设计一个引导框架,促使模型实现高质量任务分解与委派,并约束子代理返回有效结果支持主代理流程。由此生成的轨迹天然包含正确委派决策,作为监督微调数据,将委派智能内化至模型权重。所提模型SearchSwarm-30B-A3B在BrowseComp与BrowseComp-ZH上分别达到68.1和73.3,为同规模模型最佳表现。我们将公开框架、模型权重与训练数据以促进后续研究。
原文摘要 · Abstract (English)
Large language models are increasingly expected to handle complex, long-horizon real-world tasks whose context demands can grow without bound, yet model context windows remain inherently finite. Recent work explores a paradigm where a main agent decomposes tasks and dispatches subtasks to subagents, which execute and return only summarized results, conserving the main agent's context budget. However, performing this well requires delegation intelligence: the ability to decompose complex tasks, determine when and what to delegate, and integrate returned results into the ongoing workflow. Training data for this capability is scarce in naturally occurring text, and to our knowledge, how to synthesize such data and train models to acquire this capability remains largely unexplored in the open-source community. To bridge this gap, we present a preliminary exploration targeting deep research, a representative long-horizon agent task. Specifically, we design a harness that guides the model toward high-quality task decomposition and delegation, while constraining subagents to return results properly to support the main agent's workflow. The harness-guided trajectories naturally encode correct delegation decisions, which we use as supervised fine-tuning data to internalize delegation intelligence into model weights. Our resulting model, SearchSwarm-30B-A3B, achieves 68.1 on BrowseComp and 73.3 on BrowseComp-ZH, the best results among all models of comparable scale. We will release our harness, model weights, and training data to facilitate future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。