用环境实证验证技能,让模型学习更高效可靠
Evidence Over Plans: Online Trajectory Verification for Skill Distillation

- 基于任务环境交互证据,实时验证技能有效性
- 在86个任务中,生成技能优于人类编写的技能
- 适合需要低成本、可迁移技能的部署场景
代理技能可通过人类编写的程序文档显著提升任务成功率,但其质量难以在缺乏环境验证的情况下评估。现有技能生成方法过度依赖偏好日志而非直接环境交互,常导致收益微弱甚至下降。我们发现根本瓶颈在于时机:稳健的技能应基于事后证据,而非事前计划。为此,提出轨迹级指标后验蒸馏指数(PDI),衡量蒸馏技能与任务环境证据的契合度。为实现PDI,构建SPARK(结构化自主可执行任务与技能生成管道),保留任务执行证据以支持全轨迹分析。SPARK生成经环境验证的轨迹并计算PDI,将其作为在线诊断与干预信号,确保后验技能形成。在86个可运行任务中,SPARK生成的技能持续优于无技能基线,并在学生模型上超越人类编写的技能(推理成本最高降低1000倍)。结果表明,PDI引导的蒸馏能产生高效且可迁移的、基于环境交互的技能。代码已开源:https://github.com/EtaYang10th/spark-skills。
原文摘要 · Abstract (English)
Agent skills can remarkably improve task success rates by using human-written procedural documents, but their quality is difficult to assess without environment-grounded verification. Existing skill generation methods heavily rely on preference logs rather than direct environment interaction, often yielding negligible or even degraded gains. We identify that it is a fundamental timing bottleneck: robust skills should be posterior-based, distilled from empirical environment interaction rather than prior plans. In this study, we introduce the Posterior Distillation Index (PDI), a trajectory-level metric that quantifies how well a distilled skill is grounded in the task-environment evidence. To operationalize PDI, we present SPARK (Structured Pipelines for Autonomous Runnable tasKs and sKill generation) for preserving task execution evidence towards full trajectory-level analysis. SPARK generates environment-verified trajectories used to compute PDI, and it applies PDI as an online diagnostic and intervention signal to ensure posterior skill formation. Across 86 runnable tasks, SPARK-generated skills consistently surpass no-skill baselines and outperform human-written skills on student models (inference cost up to 1,000x cheaper than teacher models). These findings show that PDI-guided distillation produces efficient and transferable skills grounded in the task-environment interaction. We release our code at https://github.com/EtaYang10th/spark-skills .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。