arXiv:2608.07449cs.AIcs.CL2026-08

让AI智能体通过闭环诊断和近端优化自我进化技能,准确率提升3%。

SkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient Descent

论文配图:SkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient Descent
图 1 · 摘自论文原文
  • 基于近端梯度思想,闭环迭代诊断并修正技能文本。
  • 在多个模型上平均准确率提升3个百分点,优于最强基线。
  • 适合需要长期积累与优化任务技能的AI系统研发者。

大型语言模型智能体通过积累过程性知识来适应重复任务,这些知识以轻量级可复用的文本形式存在,无需更新权重即可加载。现有方法通过任务执行、失败诊断和轨迹引导的文本空间更新来优化技能,但缺乏显式的诊断-结果反馈机制,且将删除视为通用编辑操作而非知识整合的专用手段。我们提出SkillProx,一个受近端梯度启发的前向-后向框架,将闭环诊断演化与效用感知的近端精炼相结合。基于兼顾任务损失与技能复杂度的复合目标,前向阶段在相同任务批次上重执行诊断驱动的修改,回滚退化,并将测量结果反馈至后续诊断;后向阶段将生成的技能分解为可审计的知识单元,利用冻结的留一法效用审计估计其贡献,并通过验证门控实现知识的巩固、降级或移除。在多种骨干模型上的分布内与分布外基准测试显示,SkillProx相比最强的基于梯度的基线平均准确率提升3.0个百分点。组件消融实验表明闭环诊断与近端精炼具有互补作用。

原文摘要 · Abstract (English)

LLM agents increasingly adapt to recurring tasks by accumulating procedural knowledge in skills. These skills are lightweight, reusable textual artifacts that are loaded into the agent's context without weight updates. Recent methods refine skills through iterative task execution, failure diagnosis, and trajectory-guided text-space updates. However, existing frameworks lack explicit diagnosis--outcome feedback and treat deletion as a generic edit operation rather than a dedicated mechanism for consolidating accumulated knowledge. We introduce SkillProx, a proximal-gradient-inspired forward--backward framework that couples closed-loop diagnostic evolution with utility-aware proximal refinement. Motivated by a composite objective balancing task loss and skill complexity, the forward stage re-executes diagnosis-driven edits on the same task batch, rolls back regressions, and feeds measured outcomes into subsequent diagnoses. The backward stage decomposes the resulting skill into auditable knowledge units, estimates their contributions using a frozen leave-one-out utility audit, and applies validation-gated consolidation, demotion, or removal. Experiments on in-distribution and out-of-distribution benchmarks across multiple backbone LLMs show that SkillProx improves average accuracy by 3.0 percentage points over the strongest gradient-based baseline. Component ablations demonstrate the complementary effects of closed-loop diagnosis and proximal refinement.

LLM智能体技能优化自进化文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。