arXiv:2607.24850cs.IRcs.LG2026-07被引 1

用自动生成的验证任务训练长程搜索代理,效果媲美闭源模型。

SearchArt: Training Long-Horizon Search Agent with Scalable Synthetic and Verified Task

论文配图:SearchArt: Training Long-Horizon Search Agent with Scalable Synthetic and Verified Task
图 1 · 摘自论文原文
  • 通过合成问答对与搜索轨迹构建大规模数据集
  • 在多个基准上达到74.39~70.06分,接近闭源模型性能
  • 适合研究长程推理与自主搜索的开发者

大语言模型的发展使搜索代理能够自主处理长周期、复杂任务。但训练高效搜索代理仍面临挑战:缺乏可扩展的长周期任务,且难以评估和纠正中间推理与工具使用行为。我们提出SearchArt,一个基于验证驱动的任务合成与多阶段后训练的可扩展框架。该框架从网页文档和自动生成的证据图中合成多样化的信息查询问答对及对应搜索轨迹,构建大规模复杂任务数据集。为确保合成数据可靠性,设计联合评估管道,验证问答一致性、轨迹质量与检索证据的相关性。经验证的轨迹用于包含监督微调与强化学习策略优化的多阶段训练。使用SearchArt训练的搜索代理展现出自适应规划、迭代证据聚合及长交互周期下的复杂推理能力。实验表明,仅使用27B参数的Qwen3.5模型,在BrowseComp-ZH、BrowseComp和Deepresearch-bench上分别获得74.39、70.06和52.55分,性能匹配或超越前沿闭源模型。

原文摘要 · Abstract (English)

Recent advances in large language models (LLMs) have enabled search agents to autonomously tackle complex tasks across extended search and reasoning horizons. However, training effective search agents remains challenging due to the lack of scalable and long-horizon tasks, and the difficulty of evaluating and correcting intermediate reasoning and tool-use behaviors. We introduce SearchArt, a scalable framework for training long-horizon search agents through verification-driven task synthesis and a multi-stage post-training pipeline. SearchArt constructs large-scale datasets for complex search-, research- and user-oriented tasks by synthesizing diverse information-seeking QA pairs and corresponding search trajectories from web documents and automatically generated evidence graphs. To ensure the reliability of the synthesized data, we design a verification pipeline that jointly evaluates QA consistency, trajectory quality, and the relevance of retrieved evidence. The verified trajectories are subsequently used in a multi-stage training process comprising supervised fine-tuning and reinforcement learning-based policy optimization. Search agents trained with SearchArt exhibit adaptive search planning, iterative evidence aggregation, and complex reasoning over extended interaction horizons. Experimental results demonstrate that, with only (Qwen3.5-) 27B parameters, SearchArt scores 74.39 on BrowseComp-ZH, 70.06 on BrowseComp, and 52.55 on Deepresearch-bench, matching or surpassing frontier closed-source agents on both deepsearch and deepresearch benchmarks.

搜索代理长程推理任务合成强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。