用梯度下降思想优化大模型技能,让自动化修正更高效可靠。
SkillGrad: Optimizing Agent Skills Like Gradient Descent

- 将技能包视为可优化参数,通过任务执行反馈生成修正方向
- 在两个数据集上平均比现有方法高6.7个百分点,提升显著
- 适合需要持续优化技能的智能体开发者使用
智能体技能以结构化文件形式存储可复用的程序化知识,能轻量级适配特定领域。但外部获取或自动生成的技能常存在不可靠、不完整或过时问题。现有技能演化方法多依赖启发式反思,缺乏明确优化框架。本文提出SkillGrad,一种受梯度下降启发的技能优化框架:将技能包视为待优化的结构化参数,任务执行提供轨迹级损失证据,自动诊断生成文本型梯度指示修正方向。为稳定迭代过程,引入动量代理,将重复诊断模式积累为持久记忆层。最后由基于LLM的修补器对技能包进行分层编辑更新。在SpreadsheetBench Verified和WikiTableQuestions上评估,SkillGrad在两种主干LLM上均优于基于训练的基线方法,平均提升6.7个百分点。消融实验表明,动量机制与对比诊断均对最终技能质量有贡献。
原文摘要 · Abstract (English)
Agent skills provide a lightweight way to adapt LLM agents to specialized domains by storing reusable procedural knowledge in structured files. However, whether downloaded from third parties or self-generated, these skills are often unreliable, incomplete, or outdated. Existing skill-evolution methods often address these deficiencies through heuristic reflections without an explicit optimization formulation. In this paper, we propose SkillGrad, a gradient-descent-inspired framework for optimizing agent skills. SkillGrad treats the skill package as a structured parameter to optimize in a gradient descent fashion: task executions provide trajectory-level loss evidence, automatic diagnoses then provide text-based gradients that indicate the correction directions. To stabilize optimization across iterations, a momentum agent accumulates recurring diagnostic patterns into a persistent memory overlay. Finally, an LLM-based patcher executes the parameter update by applying layer-aware edits to the skill package. Evaluated on SpreadsheetBench Verified and WikiTableQuestions, SkillGrad consistently outperforms training-based skill evolution baselines across two backbone LLMs, improving over the strongest training-based baseline by $6.7$ percentage points on average. Ablations further show that momentum and contrastive diagnosis both contribute to the final skill quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。