arXiv:2608.13120cs.AI2026-08

让智能体技能通过多轮交互持续进化,自动发现并修复深层缺陷。

SkillEvo: Self-Renewing Evolution Gradients from Multi-Turn Interaction Feedback

  • 用多轮追问生成持续反馈,逐层暴露技能缺陷
  • 在六类云服务中比自省方法高23.0分,比单轮问答高15.4分
  • 独立治理模块主动修复事实错误和结构冗余,防止优化漂移

当前智能体技能要么手工编写,要么仅通过一次大模型生成,缺乏从交互失败中自我改进的闭环。近期工作虽建立了反馈闭环,但仅依赖单轮问答评估,导致一旦首轮修复可见缺陷,进化梯度迅速衰减,多轮交互才显现的深层缺陷无法被捕捉,演化停滞。现有系统采用端到端验证分数作为单一判断标准,可拒绝劣化候选,却无法定位或修复问题根源。我们指出,持续演化的瓶颈并非编辑能力或迭代次数,而在于评估反馈能否持续提供可信的进化方向。为此提出SkillEvo:通过多轮用户模拟将评估端转化为反馈生成器,后续问题逐层揭示缺陷,每轮修订既消耗又生成新反馈;同时引入独立治理层,主动修复事实性退化与结构膨胀,防止梯度随退化累积而漂移。在六类云服务、9个生产级技能及98个技能参考文件上,SkillEvo相较自省式演化提升23.0分,较单轮问答驱动演化提升15.4分。

原文摘要 · Abstract (English)

Agent Skills are today either hand-authored or produced in a single LLM generation pass, and consequently possess no closed loop through which they might improve from the interaction failures they actually cause. Recent work does close this loop, but derives its feedback from single-turn question-answering evaluation. The consequence is a sharp asymmetry: once the first round has patched the gaps that a single exchange can reveal, the evolution gradient decays, the defects that surface only across multiple turns remain invisible, and evolution stalls. Governance in these systems is likewise driven by an end-to-end verification score, a scalar gate that can reject a degraded candidate but can neither localize nor repair its structural cause. We argue that the binding constraint on sustained skill evolution is neither editing capability nor the number of iterations, but whether the evaluation feedback keeps supplying trustworthy evolution gradients. We introduce SkillEvo, in which trustworthy feedback generates the gradient and controllable governance constrains its direction. The first component recasts multi-turn user simulation from an evaluation endpoint into a feedback generator: follow-up questions expose defects layer by layer, so that every round of revision both consumes feedback and produces new feedback. The second replaces the passive rejection of a scalar gate with an independent governance layer that actively repairs factual degradation and structural bloat, preventing the gradient from drifting as degradation accumulates. Across six categories of cloud services, 9 production Skills, and 98 skill-reference files, SkillEvo surpasses self-reflection-based evolution by 23.0 points and single- turn-QA-driven evolution by 15.4 points.

智能体演化多轮反馈持续优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。