arXiv:2608.15165cs.AI2026-08

让AI Agent通过行为验证不断进化技能,避免错误合并。

SkillCommit: Evolving Agent Skills through Behaviorally Validated Scope Expansion

论文配图:SkillCommit: Evolving Agent Skills through Behaviorally Validated Scope Expansion
图 1 · 摘自论文原文
  • 新经验先存为特定场景的补丁,保留原始行为。
  • 通过跨实例回放和LLM判断,筛选可通用的行为机制。
  • 仅当保留所有原技能行为时才抽象成高层技能,适合跨模型使用。

大型语言模型(LLM)代理可通过将历史经验转化为可复用的过程知识来持续改进,而无需更新参数。然而,现有方法常基于语义相似性或LLM判断整合经验,可能错误合并表面相关但行为不兼容的策略,导致性能下降。为此,我们提出SkillCommit,一个在线技能演化框架,能持续将经验转化为分层可复用的技能库。每个新经验初始以实例特异性补丁形式保存,保留其局部上下文中的行为验证。随着相关技能积累,SkillCommit将共享共同行为机制的技能抽象为更高级别技能。具体而言,对每个新技能,基于嵌入的检索首先识别候选相关技能;再通过跨实例回放和基于LLM的判定机制,验证这些技能是否可在不同案例间迁移并具有共同底层机制。通过双重验证的候选技能才会被抽象为高层技能,且仅当其保留所有组成技能的已验证行为时才正式提交。在RuleArena、OpenExempt和KOR-Bench上的实验表明,SkillCommit在多个领域均持续提升代理性能,并且所学技能可跨模型规模与家族迁移,支持跨模型经验共享。

原文摘要 · Abstract (English)

Large language model (LLM) agents can continually improve without parameter updates by converting historical experience into reusable procedural knowledge. However, existing methods often consolidate experience based on semantic similarity or LLM judgments, which may merge superficially related but behaviorally incompatible strategies and thereby degrade performance. To address the issue, we propose SkillCommit, an online skill evolution framework that continuously transforms experience into a hierarchical library of reusable skills. Each new experience is initially preserved as an instance-specific patch, retaining the behavior validated in its local context. As related skills accumulate, SkillCommit abstracts those sharing a common behavioral mechanism into higher-level skills. Specifically, for each incoming skill, embedding-based retrieval first identifies candidate related skills. Cross-instance replay and an LLM-based mechanism check determine whether these skills transfer across cases and share a common underlying mechanism. Candidates that pass both checks are abstracted into a higher-level skill and committed only if it preserves the validated behavior of all constituent skills. Experiments on RuleArena, OpenExempt and KOR-Bench demonstrate that SkillCommit consistently improves agent performance across diverse domains. Moreover, the learned skills transfer across model scales and families, enabling cross-model experience transfer.

Agent技能演化行为验证跨模型迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。