arXiv:2606.03461cs.AI2026-06被引 2

教得好不靠成绩高,而是看是否暴露了思考过程。

What Makes Interaction Trajectories Effective for Training Terminal Agents?

论文配图:What Makes Interaction Trajectories Effective for Training Terminal Agents?
图 1 · 摘自论文原文
  • 用真实环境任务验证代理行为,突出可观察的思考步骤
  • 仅15.3万条轨迹就让模型达到24.3%得分,数据效率超30倍
  • 适合想提升智能体泛化能力的研究者和开发者

更强的代码代理常被视为更好的教师,但这一假设未与任务难度、钩子设计和学生能力有效分离。我们通过可扩展的Terminal-Lego流水线,将多领域真实问题转化为环境验证的代理任务,发现单一性能表现并不决定教学效果:尽管Claude Opus 4.6在Terminal-Bench 2.0上得分更高,但使用得分较低的DeepSeek-V3.2生成的轨迹进行微调的学生模型展现出更强泛化能力。我们将其归因于环境接地监督(EGS):通过钩子可见的交互显式暴露‘检查-执行-验证’行为的轨迹,使学生内化稳健的问题解决流程,而非脆弱的动作序列。缩放分析显示极高的数据效率:仅15.3k条Terminal-Lego轨迹,Qwen3-32B即在Terminal-Bench 2.0上达到24.3%得分,媲美此前需超30倍数据量才达成的SOTA表现。结果表明,代理后训练的前沿已超越简单结果匹配,转向‘钩子工程’——系统性设计环境接地的交互结构,成为实现可复现、可泛化的代理智能的核心驱动力。

原文摘要 · Abstract (English)

Stronger code agents are commonly assumed to be superior teachers for post-training, yet this assumption remains poorly disentangled from task difficulty, harness design, and student capacity. We investigate this pedagogical link using Terminal-Lego, a scalable pipeline that transforms multi-domain real-world issues into environment-verified agentic tasks. Surprisingly, standalone performance does not dictate teaching efficacy: while Claude Opus 4.6 achieves higher scores on Terminal-Bench 2.0, students fine-tuned on trajectories from DeepSeek-V3.2, a lower-scoring agent, exhibit significantly stronger generalization. We attribute this "pedagogical paradox" to Environment-Grounded Supervision (EGS): trajectories that explicitly expose inspect-act-verify behaviors through harness-visible interactions allow students to internalize robust problem-solving routines rather than fragile action sequences. Scaling analysis reveals exceptional data efficiency: with only 15.3k Terminal-Lego trajectories, for example, Qwen3-32B achieves a 24.3% score on Terminal-Bench 2.0, rivaling previous SOTA performance established with over 30x the data volume. Our results suggest that the frontier of agent post-training lies beyond mere outcome-matching, shifting the focus toward "Harness Engineering", where the systematic design of environment-grounded interaction structures serves as the primary catalyst for reproducible and generalizable agentic intelligence.

代理训练数据效率泛化能力钩子工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。