arXiv:2606.13317cs.CL2026-06被引 1

让大模型智能体通过对比分析自动优化技能,提升任务完成率。

SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agents

论文配图:SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agents
图 1 · 摘自论文原文
  • 通过对比成功与失败轨迹,精准提取影响结果的关键证据。
  • 筛选不损害任务表现的技能片段,实现高质量技能合并。
  • 构建可路由的技能拓扑,只加载相关能力,提升推理效率。

LLM智能体的技能自演化方法旨在将执行轨迹转化为可复用的技能文档。然而,现有流程通常基于单条轨迹生成技能片段,盲目合并,并在推理时加载全部技能库,导致证据提取不可靠、低质或有害技能累积,且上下文利用效率低下。我们提出SkillCAT框架,将过程分解为三个阶段:(1) 对比因果提取(CCE):每项任务采样多条轨迹,对比同任务的成功与失败对,定位决定结果差异的关键证据;(2) 评估增强演化(AAE):在源任务克隆上回放候选片段,仅保留不损害任务结果的片段,并进行分层合并;(3) 拓扑感知任务执行(TTE):将演化后的技能编译为可路由的子技能拓扑,推理时仅加载任务相关的功能节点。我们在SpreadsheetBench、WikiTableQuestions和DocVQA等主流基准上评估SkillCAT,进一步测试跨模型与分布外泛化能力。在各类设置下,相比初始技能,平均得分提升高达49.69%,验证了其可靠性与有效性。

原文摘要 · Abstract (English)

Skill self-evolution methods for LLM agents aim to turn execution trajectories into reusable skill documents. However, current pipelines typically derive skill patches from a single trajectory per task, merge them indiscriminately, and load the entire skill corpus during inference. These choices lead to unreliable evidence extraction, the accumulation of low-quality or even harmful skill edits, and inefficient use of context due to irrelevant or conflicting skill content. We propose SkillCAT, a framework that decomposes this process into three stages. (1) Contrastive Causal Extraction (CCE) samples multiple trajectories per task and contrasts same-task success/failure pairs to find the evidence that explains outcome differences. (2) Assessment-Augmented Evolution (AAE) replays each candidate patch on source-task clones, retains only those that do not damage task outcomes, and then merges the retained patches hierarchically. (3) Topology-Aware Task Execution (TTE) compiles the evolved skills into routable sub-skill topologies, so that inference loads only task-relevant capability nodes. We evaluate SkillCAT on widely-used agent benchmarks, including SpreadsheetBench, WikiTableQuestions, and DocVQA, and further assess cross-model and out-of-distribution generalization. Across these settings, SkillCAT improves the average score over the initial skill by up to 49.69%, demonstrating reliable and effective skill evolution.

智能体技能演化大模型推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。