arXiv:2605.10500cs.AI2026-05被引 10

让智能体技能能自我进化,用真实使用反馈持续优化。

SkillEvolver: Skill Learning as a Meta-Skill

论文配图:SkillEvolver: Skill Learning as a Meta-Skill
图 1 · 摘自论文原文
  • 用一个元技能循环生成、部署并改进具体任务技能。
  • 在83个任务上准确率达56.8%,显著高于人工技能的43.6%。
  • 适合希望实现技能自迭代的智能体系统开发者。

当前智能体技能是静态产物:由人工编写或一次性生成后即固定不变,缺乏基于真实使用进行改进的机制。本文提出轻量级、可插拔的在线技能学习框架 SkillEvolver,其核心是一个元技能,可迭代地生成、部署并优化特定领域的技能。该方法不更新模型权重,而是直接优化技能的文本与代码,使生成结果可无缝集成到任意智能体中,无需重新训练;元技能本身也作为普通技能加载,支持协议兼容的CLI智能体调用。与仅依赖探索轨迹的蒸馏方法不同,本方案仅在技能实际部署后才进行优化,学习信号来自其他智能体使用时遇到的失败,更具真实性。优化过程通过新智能体过拟合检测机制控制,可识别潜在泄露及部署特异性故障(如运行时从不调用的‘静默绕过’模式)。在覆盖15个以上领域的83个SkillsBench任务上,SkillEvolver达到56.8%准确率,优于人工技能的43.6%和无技能基线的29.9%;在KernelBench的三个GPU内核优化任务中,平均加速比从1.16提升至1.51。

原文摘要 · Abstract (English)

Agent skills today are static artifact: authored once -- by human curation or one-shot generation from parametric knowledge -- and then consumed unchanged, with no mechanism to improve from real use. We propose \textbf{SkillEvolver}, a lightweight, plug-and-play solution for online skill learning, in which a single meta-skill iteratively authors, deploys, and refines domain-specific skills. The learning target of SkillEvolver is the skill's prose and code, not model weights, so that the resulting artifact drops into any agent without retraining; and the meta-skill itself is just another skill, loaded through the same interface by any protocol-compliant CLI-agent. Unlike trace-distillation, the meta-skill refines only after deploying the learnt skill, such that the learning signal comes from failures another agent encounters while using it -- not from exploratory traces alone. Refinement iterations are governed by a fresh-agent overfit audit that catches possible leakage as well as deployed-skill-specific failures, including the silent-bypass mode in which a skill appears valid in content but is never invoked at runtime. On $83$ SkillsBench tasks spanning $15^{+}$ domains, SkillEvolver reaches $56.8\%$ accuracy versus $43.6\%$ for curated human skills and $29.9\%$ for the no-skill baseline; on three GPU kernel optimization tasks from KernelBench, it also raises mean speedup from $1.16$ to $1.51$ on average.

智能体技能进化自迭代强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。