arXiv:2608.04804cs.SEcs.AI2026-08

先探查代码库再分配模型,成本降为五分之一仍保持高解题率。

Scrouting: Cost-Aware Routing of Coding Agents by Scouting the Repository First

  • 先用7B模型探查仓库生成可验证的修复方案手稿
  • 在266个任务上达成159题解决率,成本仅为原方法的1/5
  • 适合追求低成本高效代码修复的开发者与自动化系统

前沿语言模型可解决仓库级软件问题,但每次尝试成本高昂,现有路由仅依据问题文本选择模型。我们提出SuperScout,先探查仓库:一个7B规模的搜索器SuperScout-7B首先探索仓库,生成结构化手稿,经沙箱验证后剔除错误声明再交付;其隐藏状态结合任务文本输入基于简历的路由器,将任务分配给四个前沿修复器之一。新增修复器无需重训练。在SWE-bench Pro的完整Python子集(266个任务)中,采用官方限制预算层级时,SuperScout以约五分之一的成本达到最优单模型的解题率(159/266,最优模型为158/266),优于随机流量分配基线。无路由消融实验表明,始终使用最便宜修复器配合手稿,性能与有路由系统持平,说明手稿本身而非路由决策决定结果。配对校准研究显示,手稿主要实现能力重分配而非新增能力,提升三个低价修复器表现,轻微削弱最强修复器;在N=99时效果方向明确。搜索器的隐藏状态显著改善成本路由表现,而手稿文本本身无效。搜索器计算成本低于每任务0.5美分的GPU时间。

原文摘要 · Abstract (English)

Frontier language models can resolve repository-level software issues, but each attempt is expensive, and existing routers select a model from the issue text alone. We present SuperScout, which routes after scouting the repository: a 7B searcher, SuperScout-7B, first explores the repository and produces a structured handoff whose reproduction claims are sandbox-verified, with false claims stripped before delivery. The searcher's hidden states, together with the task text, then feed a resume-based router that dispatches the task to one of four frontier fixers. Adding a new fixer requires no retraining. On the full Python slice of SWE-bench Pro (266 tasks) under the benchmark's official capped budget tier, SuperScout matches the best single model's solve rate (159 of 266 for SuperScout, 158 for the best model) at about a fifth of the total cost per solve, and the reported configuration sits above the random traffic-splitting baseline. A no-router ablation, always the cheapest fixer with the handoff, ties the routed system on this benchmark, so the handoff rather than the routing decision carries the result. A paired calibration study points to the mechanism: the handoff appears to redistribute rather than add solving ability, lifting the three cheaper fixers while slightly hurting the strongest, though at $N=99$ the per-fixer effects are directional only; the searcher's hidden states improve cost routing on the calibration labels while the handoff's own text does not. The searcher's compute adds less than half a cent of GPU time per task.

代码修复成本优化智能路由LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。