arXiv:2605.14089cs.AI2026-05

通过流动机制实现智能体自主进化技能,解决策略坍缩与信用分配难题。

SkillFlow: Flow-Driven Recursive Skill Evolution for Agentic Orchestration

论文配图:SkillFlow: Flow-Driven Recursive Skill Evolution for Agentic Orchestration
图 1 · 摘自论文原文
  • 基于可训练监督器与动态技能库,多轮交互完成任务编排。
  • 在14个数据集上表现优于基线,显著提升问答、推理与代码生成能力。
  • 自动识别技能演化时机,实现无监督的自主能力增长,适合复杂决策场景。

近年来,基于大模型的智能体系统通过任务编排实现了复杂任务的自动化。然而,现有编排方法仍面临奖励最大化下的策略坍缩、信用分配不透明导致的梯度方差高,以及技能演化缺乏原则性训练信号等问题。为此,我们提出SkillFlow,一种基于流动的框架,以可训练的Supervisor为智能体,结合动态技能库与冻结执行器,通过多轮交互实现任务编排。SkillFlow采用温度调节轨迹平衡(TTB)损失,一种基于回归的流匹配方法,按奖励比例采样轨迹,避免策略坍缩至单一模式;同一流目标同时学习反向策略,在零额外推理成本下提供每步透明的信用分配。基于此流诊断机制,递归技能演化机制判断何时演化、创建或删除技能,并定位决策盲区,形成从训练信号到自主能力增长的闭环。在14个数据集上的实验表明,SkillFlow在问答、数学推理、代码生成及真实交互决策任务中显著优于基线。代码已开源。

原文摘要 · Abstract (English)

In recent years, a variety of powerful LLM-based agentic systems have been applied to automate complex tasks through task orchestration. However, existing orchestration methods still face key challenges, including strategy collapse under reward maximization, high gradient variance with opaque credit assignment, and unguided skill evolution whose decisions are typically made by directly prompting an LLM to judge rather than derived from principled training signals. To address these challenges, we propose SkillFlow, a flow-based framework that takes a trainable Supervisor as the agent and a structured environment with dynamic skill library and frozen executor, automating task orchestration through multi-turn interaction. SkillFlow employs Tempered Trajectory Balance (TTB), a regression-based flow-matching loss that samples trajectories proportional to reward, preserving diverse orchestration strategies rather than collapsing to a single mode. The same flow objective yields a jointly learned backward policy that provides transparent per-step credit assignment at zero additional inference cost. Building on these flow diagnostics, a recursive skill evolution mechanism determines when to evolve, what skills to create or prune, and where decision gaps lie -- closing the loop from training signal to autonomous capability growth. Experimental results on 14 datasets show that SkillFlow significantly outperforms baselines across question answering, mathematical reasoning, code generation, and real-world interactive decision making tasks. Our code is available at https://anonymous.4open.science/r/SkillFlow-E850.

智能体技能演化任务编排强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。