arXiv:2608.24358cs.AI2026-08

模型切换时的轨迹继承会带来质量损失和成本增加,称为'交接税'

The Handoff Tax: Continuing Non-Native Trajectories in LLM Agents

论文配图:The Handoff Tax: Continuing Non-Native Trajectories in LLM Agents
图 1 · 摘自论文原文
  • 通过保留、压缩或移除模型切换前的执行轨迹,测试不同交接方式
  • 完整轨迹传递仅恢复不到一半的性能差距,代价却显著升高
  • 降级时移除高模型轨迹更好,升级时减少低模型轨迹更优

编码代理需执行跨数十次模型调用、工具使用和代码修改的长期任务。用户面临成本与质量权衡:在廉价模型无法应对时升级到更强模型,或在完成复杂推理后降级。每次切换都要求接收方继续由另一模型生成的非本源轨迹。本文研究这种交接对质量与成本的影响,并考察接收方继承的轨迹信息差异如何改变结果。采用来自Claude和GPT系列的低成本低能力(LC)与高成本高能力(HC)模型组合,测试交接方向、时机与接口,比较完整轨迹传递、轨迹压缩与轨迹清除(保留仓库状态)。在两个模型家族中,完整轨迹升级仅恢复低于50%的LC至HC性能差距,且成本大幅上升。此代价-质量惩罚被称为‘交接税’。相反,降级策略提供更优的成本-质量平衡。有趣的是,最优接口随方向反转:减少LC模型轨迹信息有助于提升升级质量,而清除HC模型轨迹则损害降级质量。

原文摘要 · Abstract (English)

Coding agents perform long-running tasks spanning dozens of model calls, tool uses, and code edits. As these runs unfold, users face a practical cost-quality trade-off: escalating to a stronger model when a cheaper one struggles, or downshifting once the hard reasoning is complete. Each switch requires the receiver to continue a non-native trajectory produced by another model. We study how this handoff affects quality and cost, and how varying the trajectory information inherited by the receiver changes the outcome. Using pairs of low-cost, low-capability (LC) and high-cost, high-capability (HC) models from the Claude and GPT families, we vary handoff direction, timing, and interface, comparing full-trajectory transfer, compaction, and trajectory removal while preserving the repository state. Across both model families, full-trajectory escalation recovers less than half of the LC-to-HC quality gap while incurring a substantial cost premium. We term this cost-quality penalty the handoff tax. By contrast, downshift offers a favorable cost-quality point. Interestingly, the preferred interface also reverses with direction: reducing LC-model trajectory information improves escalation quality, whereas removing the HC-model trajectory reduces downshift quality.

大模型代理轨迹继承成本优化交接税

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。