让大模型代理自我迭代改进技能,实现持续进化。
MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution

- 设计双时标框架,让技能与改进方法同步进化。
- 在三个基准上提升准确率,最高达23.54点。
- 无需额外模型,适合长期任务的智能体开发。
近期的大模型代理能处理更长周期、开放性的复杂任务,外部技能(可复用的过程知识)进一步扩展了其能力。然而,固定的手动编写技能通常不够优化,难以适应任务多样性。自改进代理通过执行轨迹重写自身技能文件,显著提升性能。但现有方法非递归:仅改进任务技能(做什么),而改进过程(如何改进)一旦设定便固定不变。本文提出MetaSkill-Evolve,一种双时标框架,实现技能改进的递归:每个分支同时携带任务技能 $s$ 与局部元技能 $m=(ψ,σ,α,π,ε)$,其五项参数分别控制分析器、检索器、分配器、提议器和演化器。任务技能在快速循环中演进,而元技能在慢速循环中通过相同管道自我演化,无需额外模型或目标。所有五个组件共享单一冻结主干,实验显示其在OfficeQA、SealQA、ALFWorld三个代理基准上超越无技能、静态技能及单级演化基线,对原始主干的测试准确率分别提升+23.54、+16.09、+1.92点。
原文摘要 · Abstract (English)
Recent LLM agents tackle increasingly long-horizon, open-ended tasks, and external skills, reusable procedural knowledge supplied to the agent, further extend this capability. However, a fixed, hand-authored skill is rarely optimal, and cannot adapt to the diversity of tasks an agent encounters. Self-improving agents address this by rewriting their own skill files from execution traces, yielding meaningful gains on challenging benchmarks. Yet such self-evolution remains non-recursive: it improves only the task skill (what the agent does) while the improvement procedure (how it improves) is authored once and held fixed. We introduce MetaSkill-Evolve, a two-timescale framework that makes agentic skill improvement recursive: every branch carries both a task skill $s$ and a branch-local meta-skill $m=(ψ,σ,α,π,\varepsilon)$ whose five components parameterise the Analyzer, Retriever, Allocator, Proposer, and Evolver agents of the improvement pipeline. Task skills evolve on a fast loop while the meta-skill evolves on a slower one under the same pipeline applied to itself, with no additional model or objective. With all five pipeline agents sharing a single frozen backbone, MetaSkill-Evolve outperforms no-skill, static-skill, and single-level evolution baselines on three agentic benchmarks (OfficeQA, SealQA, ALFWorld), improving held-out test accuracy over the raw backbone by +23.54, +16.09, and +1.92 points respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。