arXiv:2607.16900cs.AI2026-07被引 2

用大模型生成无需真实环境的API调用数据,解决训练难题。

Environment-free Synthetic Data Generation for API-Calling Agents

  • 用大模型当数字世界,根据API说明自动生成任务与响应。
  • 在AppWorld和OfficeBench上微调后性能显著提升。
  • 适合想低成本训练API调用智能体的研究者与开发者。

训练调用API的大语言模型智能体需要大量高质量轨迹数据。但大规模收集此类数据通常需完整可执行的环境及预填充的后端数据库,成为可扩展性的主要瓶颈。为此,我们提出一种无环境的合成数据生成方法,利用大模型作为实时数字世界模型。仅凭API规范,该方法生成模拟智能体与状态化环境交互的轨迹。具体而言,大模型首先生成可由给定API解决的多样化任务;教师智能体迭代求解每个任务,同时大模型模拟器根据任务上下文和仿真历史生成连贯的合成API响应;最后,大模型裁判对轨迹进行筛选以保证数据质量。我们在具有信息检索和状态改变任务的AppWorld和OfficeBench基准上评估该方法。在合成数据上微调模型取得显著性能提升,证明了无需任何可执行环境即可生成有效监督信号。结果表明,基于大模型的API仿真是跨多样API生态训练智能体的一种实用且可扩展的解决方案。

原文摘要 · Abstract (English)

Training API-calling large language model (LLM) agents demands massive amounts of high-quality trajectories. However, collecting such data at scale typically requires fully implemented environments with executable APIs and realistic, pre-populated backend databases, creating a major bottleneck for scalability. To overcome this, we propose an environment-free synthetic data generation approach that leverages LLMs as on-the-fly digital world models. Given only API specifications, our method generates trajectories mimicking interactions between an agent and a stateful environment. Specifically, an LLM first generates diverse tasks solvable with the provided APIs. A teacher agent then iteratively solves each task while an LLM simulator generates coherent synthetic API responses conditioned on the task context and simulation history. Finally, an LLM judge filters the trajectories to ensure the quality of the resulting dataset. We evaluate our approach on the challenging AppWorld and OfficeBench benchmarks, which include both information-retrieval and state-changing tasks. Fine-tuning models on our synthetic data yields significant performance gains, demonstrating that effective supervision for API-calling agents can be generated without any executable environment. Our results establish LLM-based API simulation as a practical, scalable solution for training agents across diverse API ecosystems.

API调用合成数据大模型智能体训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。