arXiv:2605.23904cs.AIcs.CL2026-05被引 63

让智能体技能像模型参数一样可系统优化,提升性能且无需额外推理调用。

SkillOpt: Executive Strategy for Self-Evolving Agent Skills

论文配图:SkillOpt: Executive Strategy for Self-Evolving Agent Skills
图 1 · 摘自论文原文
  • 将技能视为外部状态,用可控编辑方式逐步优化文本技能
  • 在6个基准上3种执行环境均超越所有对比方法,最高提效24.8点
  • 优化后技能可跨模型、跨环境迁移,保持高性能

当前智能体技能多为手工设计或一次性生成,缺乏可控的自我进化机制,无法可靠提升。本文提出SkillOpt,首个系统性可控的文本空间技能优化器:通过独立优化器模型,将评分回放转化为有界增删改操作,仅当验证分数严格提升时才接受编辑。采用文本学习率预算、拒绝编辑缓冲区及逐轮慢更新机制,训练稳定且部署零推理调用。在6个基准、7个目标模型、3种执行环境(直接对话、Codex、Claude Code)中,共52个评测单元全部最优或并列领先,显著优于人类、单次提示LLM、Trace2Skill、TextGrad、GEPA和EvoSkill。在GPT-5.5上,直接对话提升+23.5分,Codex代理循环内提升+24.8分,Claude Code内提升+19.1分。迁移实验表明,优化后的技能在不同模型尺度、执行环境间及新数学任务上仍具价值,无需再优化。代码见:https://aka.ms/skillopt

原文摘要 · Abstract (English)

Agent skills today are hand-crafted, generated one-shot, or evolved through loosely controlled self-revision, none of which behaves like a deep-learning optimizer for the skill, and none of which reliably improves over its starting point under feedback. We argue the skill should instead be trained as the external state of a frozen agent, with the same discipline that makes weight-space optimization reproducible. SkillOpt is, to our knowledge, the first systematic controllable text-space optimizer for agent skills: a separate optimizer model turns scored rollouts into bounded add/delete/replace edits on a single skill document, and an edit is accepted only when it strictly improves a held-out validation score. A textual learning-rate budget, rejected-edit buffer, and epoch-wise slow/meta update make skill training stable while adding zero inference-time model calls at deployment. Across six benchmarks, seven target models, and three execution harnesses (direct chat, Codex, Claude Code), SkillOpt is best or tied on all 52 evaluated (model, benchmark, harness) cells and beats every per-cell competitor among human, one-shot LLM, Trace2Skill, TextGrad, GEPA, and EvoSkill skills. On GPT-5.5 it lifts the average no-skill accuracy by +23.5 points in direct chat, by +24.8 inside the Codex agentic loop, and by +19.1 inside Claude Code. Transfer experiments further show that optimized skill artifacts retain value when moved across model scales, between Codex and Claude Code execution environments, and to a nearby math benchmark without further optimization. Code: https://aka.ms/skillopt

智能体技能优化自进化文本编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。