从智能体执行轨迹中提炼可迁移技能,提升多场景任务表现。
Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skills

- 通过归纳推理将多条执行轨迹整合为统一技能库。
- 在WikiTableQuestions上使大模型性能提升57.65个百分点。
- 生成的技能可跨模型规模、家族及分布外场景复用。
大型语言模型代理日益依赖领域特定技能,但手动编写难以扩展,纯参数化生成的技能常遗漏关键操作陷阱。我们提出Trace2Skill框架,通过归纳推理将并行的广泛执行轨迹整合为统一技能目录,既可深化已有人工编写的技能,也能从弱化的大模型草稿中生成有效技能。实验表明,该方法在办公流程、数学推理和视觉问答等多样领域均具有效性。重要的是,所生成的技能并非仅对训练轨迹的机械记忆:它们常能跨模型规模、跨模型家族以及在分布外设置下实现迁移。例如,基于Qwen3.5-35B轨迹演化的技能,使Qwen3.5-122B代理在WikiTableQuestions上的表现提升高达57.65个百分点。进一步分析显示,Trace2Skill优于顺序技能编辑与ReasoningBank式检索记忆,能将重复失败与应对方案压缩为标准操作流程(SoPs),生成无需参数更新或测试时检索即可复用的便携技能。
原文摘要 · Abstract (English)
Large Language Model (LLM) agents increasingly rely on domain-specific skills, yet manually authoring such skills does not scale, and skills generated purely from parametric knowledge often miss critical operational pitfalls. We introduce Trace2Skill, a framework that consolidates broad execution trajectories in parallel into a unified skill directory through inductive reasoning over agent experience. Trace2Skill supports both deepening existing human-written skills and creating useful skills from weak LLM-generated drafts. Experiments demonstrate the effectiveness of Trace2Skill across diverse domains, including office workflows, math reasoning, and vision QA. Importantly, the evolved skills are not merely memorized artifacts of the trajectories used to create them: they often transfer across model scales, across model families, and to out-of-distribution settings. For example, skills evolved from Qwen3.5-35B trajectories improve a Qwen3.5-122B agent by up to $57.65$ percentage points on WikiTableQuestions. Further analyses show that Trace2Skill outperforms sequential skill editing and ReasoningBank-style retrieval memories, compresses recurring failures and workarounds into standard operating procedures (SoPs), and yields portable skills that can be reused without parameter updates or test-time retrieval.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。