arXiv:2605.10999cs.LGcs.AI2026-05被引 17

用多智能体自动合成可验证的高质量技能,提升大模型代理性能。

SkillGen: Verified Inference-Time Agent Skill Synthesis

论文配图:SkillGen: Verified Inference-Time Agent Skill Synthesis
图 1 · 摘自论文原文
  • 基于成功与失败轨迹对比,挖掘可复用的成功模式
  • 生成候选技能并迭代优化,显著提升测试集表现
  • 适合需要可解释、可迁移技能的智能体开发人员

技能是无需微调即可增强大语言模型代理能力的有力途径,同时保持新增流程的可重用性和可控性。然而高质量技能仍主要依赖人工编写。我们提出 SkillGen,一个从基础智能体轨迹中合成单一可审计技能的多智能体框架。输出为人类可读的成果,可在使用前审查。不同于简单总结轨迹,SkillGen 通过对比成功与失败轨迹,识别可复用的成功模式、反复出现的失败原因,以及在邻近成功中出现但在失败中缺失的行为。随后生成候选技能并进行迭代优化。其关键创新在于将技能建模为干预手段,通过实证比较同一实例在有无技能时的表现,从而同时衡量修复(改善基线失败)和退化(破坏基线成功)效果。在多个智能体和数据集上,SkillGen 持续提升保留测试性能,优于现有技能生成基线,并产生跨模型可迁移的技能。

原文摘要 · Abstract (English)

Skills are a promising way to improve LLM agent capabilities without retraining, while keeping the added procedure reusable and controllable. However, high-quality skills are still largely written by hand. We introduce SkillGen, a multi-agent framework that synthesizes a single auditable skill from trajectories generated by a base agent. The output is a human-readable artifact that can be inspected before use. Rather than merely summarizing trajectories, SkillGen leverages contrastive induction over both successful and failed trajectories to identify reusable success patterns, recurring failure modes, and behaviors that appear in nearby successes but are missing from failures. SkillGen then generates candidate skills and iteratively refines the skill. A key novelty in SkillGen is that we model agent skills as interventions to empirically verify the net effect of skills on the overall performance. Specifically, we compare outcomes on the same instances with and without the skill, so that we account for both repairs (cases where the skill fixes a baseline failure) and regressions (cases where the skill breaks a baseline success). Across a broad range of agents and datasets, SkillGen consistently improves held-out performance, outperforms existing skill-generation baselines, and produces skills that transfer across models.

智能体技能合成可验证多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。