arXiv:2608.07424cs.AI2026-08

通过智能分配计算资源,让模型推理更省算力且更准确。

CoBa: Cost-Effective Test-Time Scaling via Compute-Balanced Routing

论文配图:CoBa: Cost-Effective Test-Time Scaling via Compute-Balanced Routing
图 1 · 摘自论文原文
  • 根据候选结果质量动态分配生成、验证或停止的计算资源。
  • 在多个数学数据集上达到85.13%准确率,仅用一半左右的计算量。
  • 适合追求高效推理的本地部署或资源受限场景使用。

测试时扩展通常通过在单一维度上增加计算量实现:生成更多解、延长思维链或使用更强的评估器。在固定推理预算下,这些选择相互竞争。本文将测试时推理建模为计算分配问题,系统需决定下一单位计算应投入生成、验证还是停止。我们提出CoBa,一种计算平衡的路由策略:先生成少量候选,广泛应用低成本验证,并将不确定或高价值候选路由至强验证。在涵盖MATH-500、AIME 2024/2025、AMC 2023及过程符号推理的3,129个示例生成评估中,CoBa-Routed-Strong达到85.13%宏观准确率,与85.20%的自评估加权投票代理统计无显著差异,但参数加权令牌减少49.1%;同时以58.9%更少的令牌匹配最佳16选一多数投票,仅在极小精度上落后,而后者成本远高于前者。配对检验显示其显著优于单样本解码,与池内最优者之间的差距则揭示了更精细路由的潜力。对本地推理系统而言,测试时扩展的核心变为:下一步计算何处最值。

原文摘要 · Abstract (English)

Test-time scaling is often implemented by spending more compute along one axis: sampling more solutions, extending a chain of thought, or applying a stronger evaluator. Under a fixed inference budget, these choices compete. This paper formulates test-time reasoning as a compute-allocation problem in which a system must decide whether the next unit of compute should be spent on generation, verification, or stopping. We introduce CoBa, a compute-balanced routing policy that first obtains a small set of candidates, applies cheap verification broadly, and routes uncertain or high-value candidates to stronger verification. On 3,129 example-generator evaluations spanning MATH-500, AIME 2024/2025, AMC 2023, and procedural symbolic reasoning, CoBa-Routed-Strong reaches 85.13% macro accuracy, statistically matching a self-evaluation weighted-voting proxy at 85.20% while using 49.1% fewer parameter-weighted tokens. It also matches best-of-16 majority voting within 0.01 macro-accuracy points while using 58.9% fewer parameter-weighted tokens; paired tests retain a small best-of-16 edge at substantially higher cost. Paired bootstrap tests show significant gains over single-sample decoding, while the remaining gap to the pool oracle exposes headroom for sharper routing. For local reasoning systems, test-time scaling becomes a question of where the next computation is most valuable.

推理优化计算分配高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。