arXiv:2606.01139cs.AI2026-06被引 12

用执行痕迹迭代优化LLM生成的初始技能,提升智能体任务成功率。

SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision

论文配图:SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision
图 1 · 摘自论文原文
  • 基于执行证据诊断技能缺陷,从记忆库中检索修复原则并修正。
  • 在多基准测试中将成功率从36.05%提升至61.63%,显著优于一次性生成。
  • 修复后的技能可跨执行器与环境复用,具备通用性,适合构建鲁棒智能体。

智能体技能是使大语言模型(LLM)智能体执行流程、验证约束并从失败中恢复的程序性组件。现有自进化方法依赖积累的轨迹来优化技能,但在冷启动场景下表现不佳,仅能依赖专家编写或单次生成的技能。前者成本高且与实际执行脱节,后者虽语法正确但行为能力弱。为此,我们提出SkillRevise,一种基于执行证据的迭代优化框架。该框架通过分析执行痕迹诊断技能缺陷,从通用记忆库中检索修复原则,并进行执行锚定式修改。通过重新执行候选技能,在修订预算内保留首个通过验证的版本;若无成功候选,则退化为基于实证效用的选择。在三个基准和五种LLM上的评估显示,SkillRevise显著优于单次生成基线,将SkillsBench上的成功率从36.05%提升至61.63%。此外,修复后的技能可在不同执行器和任务环境中迁移,表明其捕捉到了超越单一执行器的可复用过程知识。

原文摘要 · Abstract (English)

Agent skills are procedural artifacts that enable LLM agents to execute workflows, verify constraints, and recover from failures. Existing self-evolving methods refine skills using accumulated trajectories. However, they struggle in cold-start settings, where only an initial, imperfect skill is available. Consequently, skill construction defaults to expert authoring or one-shot LLM generation. Expert-authored skills are costly and may not align with how LLM agents actually execute tasks, while one-shot generated skills can be syntactically well formed yet behaviorally weak. To bridge this gap, we propose SkillRevise, an execution-grounded framework designed to iteratively refine these initial skills. SkillRevise diagnoses skill defects from execution evidence, retrieves relevant repair principles from a general memory, and applies execution-anchored edits. By re-executing candidates, it retains the first verifier-passing skill within the revision budget and falls back to empirical utility only when no candidate succeeds. Evaluated across three benchmarks and five LLMs, SkillRevise substantially outperforms one-shot baselines, improving the base agent's success rate on SkillsBench from 36.05% to 61.63%. Furthermore, the revised skills transfer across both executors and task environments, suggesting that SkillRevise captures reusable procedural knowledge beyond any single executor.

智能体技能优化大模型自进化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。