arXiv:2511.09572cs.AIcs.LG2025-11被引 6

用大模型自动生成可扩展的工具使用环境,助力智能体训练。

SynthTools: A Framework for Scaling Synthetic Tools for Agent Development

  • 全链路大模型驱动,从环境生成到任务构造端到端实现
  • 产出7.4万+验证工具、8万+可验证任务,覆盖6800个环境
  • 生成的训练数据让模型在真实接口上表现提升,适合训练工具调用智能体

为使智能体能利用外部工具完成复杂、长周期任务,需要大量多样且可控的工具使用环境。我们提出SynthTools,一个全由大模型驱动的端到端框架,涵盖环境生成、模拟、验证和任务构建全过程。该框架通过层级化结构构建领域相关的多样化工具环境;通过模拟与验证确保工具可稳定仿真并剔除不可靠项;通过自底向上生成可解且可验证的任务及多步轨迹,灵活控制难度、长度、组合方式与领域焦点。作为具体实现,我们发布包含73,883个验证工具、6,800个环境、100个领域以及79,925个可验证任务的数据集,并提供大规模生成轨迹的管道。基于这些任务轨迹训练的Qwen3模型在多个工具使用基准(包括真实API)上取得性能提升,表明合成数据训练出的工具使用能力可迁移到部分真实场景。结果表明,SynthTools可作为大规模工具使用智能体训练的重要基础设施。

原文摘要 · Abstract (English)

For agentic systems to use external tools to solve complex, long-horizon tasks, we need a large set of diverse and controllable tool-use environments. We introduce SynthTools, a fully LLM-based pipeline spanning the entire lifecycle: environment generation, simulation, validation and task construction. By operating end-to-end through LLMs, our framework complements other tool-use environments bottlenecked by the complexity of real APIs, and ensures scalability and controllability by design. The framework consists of three components: top-down environment generation, which hierarchically constructs diverse, domain-grounded tool environments; environment simulation and validation, which ensures tools can be reliably emulated and filters out those that cannot; and bottom-up task and trajectory generation, which produces solvable and verifiable tasks together with multi-step trajectories, exposing control over difficulty, length, trajectory composition, and domain focus to guarantee flexibility. As a concrete instantiation, we release the dataset comprising $73{,}883$ validated tools across $6{,}800$ environments and $100$ fields, $79{,}925$ verifiable tasks as well as the pipeline to generate trajectories at scale. Training Qwen3 models of various sizes on a corpus of trajectories generated from these tasks yields gains across multiple tool-use benchmarks, including real APIs, indicating tool-use capabilities trained on synthetic data may transfer to some real environments. Together, these results suggest that SynthTools can serve as a useful infrastructure for large-scale training of tool-use agents.

智能体合成数据工具调用大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。