arXiv:2609.08944cs.AI2026-09

让智能体技能自动进化更稳定高效,减少迭代次数和成本。

SkillAdam: Stable and Efficient Skill Evolution for Agents

论文配图:SkillAdam: Stable and Efficient Skill Evolution for Agents
图 1 · 摘自论文原文
  • 用记忆机制记录问题与修复尝试,稳定更新方向。
  • 根据近期反馈波动动态调整修改幅度,提升优化效率。
  • 适合需要低成本自进化技能的智能体系统开发者。

智能体技能为冻结的语言模型智能体提供了轻量级领域知识与程序指导,但高质量技能的获取仍成本高昂且难以扩展。人工编写需大量人力,现有自进化方法虽能通过执行反馈循环修正技能,但其启发式更新策略常导致优化不稳定、迭代效率低。本文识别出两个核心挑战:方向稳定性要求有效修正积累而非被局部反馈覆盖;更新适应性要求每次修改范围反映近期案例改进的一致性。为此提出SkillAdam,一种受Adam启发的离散非可微技能文档优化框架。作为一阶矩的类比,优化记忆记录已发现的问题及先前解决方案的效果,以稳定更新方向;作为二阶矩的类比,基于波动性的编辑预算追踪近期案例改进的历史加权变异,自适应控制更新幅度。在涵盖短周期与长周期任务的七个基准上,SkillAdam实现领先性能,优化过程更稳定,显著减少所需迭代次数与整体成本。代码库:https://github.com/ruc-datalab/SkillAdam

原文摘要 · Abstract (English)

Agent skills provide a lightweight way to equip frozen language-model agents with domain knowledge and procedural guidance, yet obtaining high-quality skills remains costly and difficult to scale. Expert-written skills require substantial human effort. Recent skill self-evolution methods automate an iterative loop that uses execution feedback to revise skills, but their heuristic update strategies often yield unstable optimization and low iteration efficiency. We identify two challenges in realizing stable and efficient skill self-evolution. Direction Stability requires effective corrections to accumulate rather than be overwritten by iteration-local feedback. Update Adaptivity requires the scope of each revision to reflect the consistency of recent case-level improvements. We introduce SkillAdam, an Adam-inspired framework for optimizing discrete and non-differentiable skill documents. As a functional analogue of Adam's first moment, an optimization memory records identified problems and the outcomes of prior solution attempts to stabilize the update direction. As a functional analogue of Adam's second moment, a volatility-driven edit budget tracks the history-weighted variation of recent case-level improvements and adaptively controls the update magnitude. Across seven benchmarks that span short- and long-horizon tasks, SkillAdam achieves state-of-the-art performance with more stable optimization dynamics. It also obtains stronger skills with substantially fewer optimization iterations and lower cost than prior methods. Code repository: https://github.com/ruc-datalab/SkillAdam

智能体技能进化自优化强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。