让弱模型从强模型失败中学习,自动提炼可复用的技能补丁。
SKILL-KD: Contrastive Skill Distillation for LLM Agents

- 通过对比师生轨迹,提取可执行的技能补丁作为知识载体。
- 在五项基准上优于固定模型基线,提升弱模型表现。
- 支持迭代优化与防漂移机制,适合低资源模型训练。
基于技能的提示已成为提升大语言模型代理性能的有效方法,但现有技能获取方式常将技能视为经验摘要、记忆条目或成功示范的直接总结,导致能力较弱的学生代理难以从中学习:当学生因缺乏任务知识或操作策略而失败时,其失败轨迹可能无法提供足够证据推断缺失行为,而教师轨迹又过于隐含,难以被内化为可复用的指导。本文提出SKILL-KD,一种对比式技能蒸馏框架,将技能视为不同能力代理间的显式知识传递介质。给定学生失败轨迹与同一任务下的教师轨迹,SKILL-KD将二者可行动差异提炼为文本形式的技能补丁,通过重运行学生评估补丁效果,并在学生仍失败时迭代优化补丁。为防止重复局部更新引发技能漂移,SKILL-KD维护带追踪链接的编辑历史,执行漂移感知的技能整合,决定每个补丁应新增规则、修改或删除已有规则,或跳过。在五个代理基准和两种学生设置下,SKILL-KD始终优于固定模型适应基线。
原文摘要 · Abstract (English)
Skill-based prompting has become a practical mechanism for improving large language model (LLM) agents, yet existing skill acquisition methods often treat skills as experience summaries, memory entries, or direct summaries of successful demonstrations. This creates a mismatch for weaker student agents: when a student fails because it lacks task knowledge or operational strategy, its failed trajectory may not contain enough evidence to infer the missing behavior, while the teacher trajectory may be too implicit to be internalized as reusable guidance. We propose SKILL-KD, a contrastive skill distillation framework that treats skills as an explicit distillation medium between agents of different capabilities. Given a student failure and the teacher trajectory on the same task, SKILL-KD distills their actionable discrepancy into a textual skill patch, evaluates the patch by re-running the student, and iteratively refines the patch when the student still fails. To prevent repeated local updates from causing skill drift, SKILL-KD further maintains trace-linked edit histories and performs Drift-Aware Skill Consolidation, deciding whether each patch should add a new rule, delete or modify an existing rule, or be skipped. Across five agent benchmarks and two student settings, SKILL-KD consistently improves frozen student agents over fixed-model adaptation baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。