arXiv:2603.02766cs.AIcs.MA2026-03被引 65

自动发现并优化多智能体任务技能,提升代码代理的专用能力。

EvoSkill: Automated Skill Discovery for Multi-Agent Systems

  • 通过分析执行失败,迭代生成和改进可复用的任务技能。
  • 在OfficeQA上准确率提升7.3%,在SealQA上提升12.1%。
  • 技能具备零样本迁移能力,跨任务使用仍有效。

代码代理作为通用问题求解器日益普及,但其灵活性并不等同于特定领域的专业能力。近期工作通过引入‘代理技能’——可复用的工作流与代码——来增强代理的领域专长。当前多数技能为人工设计,现有进化方法仅优化与特定模型和任务紧密耦合的底层内容(如提示词与代码)。我们提出自演化框架EvoSkill,通过迭代失败分析自动发现并优化代理技能。EvoSkill分析执行失败,提出新技能或对现有技能进行修改,并将其结构化为可复用的技能文件夹。采用帕累托前沿筛选机制,仅保留能提升保留验证集性能且底层模型冻结的技能。我们在两个基准上评估:OfficeQA(基于美国财政部数据的具身推理任务),准确率从60.6%提升至67.9%(+7.3%);SealQA(带噪声检索的搜索增强型问答任务),准确率从26.6%提升至38.7%(+12.1%)。此外,我们研究了在一项任务上演化的技能对另一项任务的零样本迁移能力:在SealQA上演化的技能无需修改即可零样本迁移到BrowseComp,准确率提升5.3%,表明技能级优化可产生超越训练任务的可迁移能力。

原文摘要 · Abstract (English)

Coding agents are increasingly used as general-purpose problem solvers, but their flexibility does not by itself confer the domain expertise needed for specialized tasks. Recent work addresses this through \textit{agent skills}: reusable workflows, and code, that augment agents with domain-specific capabilities. Most skills today are hand-crafted, and existing evolutionary approaches optimize low-level artifacts (e.g. prompts \& code) that are tightly coupled to specific models and tasks. We introduce \textbf{EvoSkill}, a self-evolving framework that automatically discovers and refines agent skills through iterative failure analysis. EvoSkill analyzes execution failures, proposes new skills or edits to existing ones, and materializes them into structured, reusable skill folders. A Pareto frontier of agent programs governs selection, retaining only skills that improve held-out validation performance while the underlying model remains frozen. We evaluate EvoSkill on two benchmarks: OfficeQA, a grounded reasoning benchmark over U.S.\ Treasury data, where it improves exact-match accuracy by \textbf{7.3\%} (60.6\% $\to$ 67.9\%); and SealQA, a search-augmented QA benchmark with noisy retrieval, where it yields a \textbf{12.1\%} gain (26.6\% $\to$ 38.7\%). We also investigate the zero-shot transfer capabilties of skills evolved on one task to the other; in particular: skills evolved from SealQA transfers zero-shot to BrowseComp, improving accuracy by \textbf{5.3\%} without modification demonstrating that skill-level optimization produces transferable capabilities beyond the training task.

多智能体技能发现自动演化零样本迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。