arXiv:2608.02287cs.AI2026-08

用验证过的合成数据提升大模型使用技能的能力

SKT: Skill-Use Training at Scale via Verified Synthetic Data Generation

论文配图:SKT: Skill-Use Training at Scale via Verified Synthetic Data Generation
图 1 · 摘自论文原文
  • 构建可验证的合成数据流水线,自动组合技能生成任务和执行轨迹
  • 基于2000个公开技能生成4000个任务包和27164条成功轨迹
  • 适用于多种模型与接口,能显著提升技能调用效果

代理技能已成为赋予语言模型代理可复用程序知识的重要机制。然而,仅提供技能并不能保证当前模型能有效识别、应用和协调它们。为提升技能使用能力,我们提出SKT,一种通过大规模代理技能集合构建技能基础任务和可执行轨迹的验证数据合成流程。SKT选择合适的单技能与多技能配置,通过规则与代理双重验证并结合反馈修复,仅保留充分使用每个必要技能的成功轨迹。利用2000个公开技能,SKT生成4000个任务包和27,164条已验证轨迹。基于相同流程及独立测试集,我们进一步构建了SkillEval——一个保留的可执行基准,用于评估技能使用。跨多种模型、基准与代理框架的实验表明,在SKT生成轨迹上进行监督微调,能持续提升技能使用表现。验证消融实验、跨框架评估与扩展实验进一步证明,这些提升依赖高质量监督,不局限于单一接口,并随技能覆盖范围扩大而增强。结果共同确立了验证数据合成在技能使用训练中的有效性和可扩展性。

原文摘要 · Abstract (English)

Agent skills have become an important mechanism for equipping language-model agents with reusable procedural knowledge. However, providing skills alone does not guarantee that current models can effectively identify, apply, and coordinate them. To improve skill-use capabilities, we introduce SKT, a verified data synthesis pipeline that constructs skill-grounded tasks and executable trajectories from large collections of agent skills. SKT selects suitable single-skill and multi-skill configurations, synthesizes tasks through rule-based and agent-based verification with feedback-guided repair, and retains only successful trajectories that substantially use every required skill. Using 2,000 public skills, SKT produces 4,000 task packages and 27,164 verified trajectories. Based on the same pipeline and a disjoint test pool, we further construct SkillEval, a held-out executable benchmark for evaluating skill use. Experiments across diverse models, benchmarks, and agent harnesses show that supervised fine-tuning on SKT-generated trajectories consistently improves skill-use performance. Verification ablations, cross-harness evaluation, and scaling experiments further demonstrate that these gains depend on high-quality supervision, extend beyond a single agent interface, and increase with broader skill coverage. Together, these results establish verified data synthesis as an effective and scalable approach for skill-use training.

技能学习合成数据强化学习智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。