arXiv:2608.08020cs.AI2026-08

通过动态聚焦计算资源,提升大模型推理效率与准确率。

Thought-Level Beam Search for Reasoning

论文配图:Thought-Level Beam Search for Reasoning
图 1 · 摘自论文原文
  • 按思维阶段分步筛选,实时优化计算分配。
  • 在相同硬件下,准确率最高提升6.7%,吞吐量超2倍。
  • 适合追求高效推理的开发者和部署场景。

测试时计算扩展是大型推理模型性能提升的主要驱动力,但当前方法存在严重效率瓶颈,迫使问题从‘投入多少算力’转向‘如何分配算力’。本文将推理过程建模为受限的计算分配问题。现有范式在固定硬件预算下无法有效分配算力:传统并行采样独立处理路径,导致内存瓶颈;减法剪枝则浪费硬件资源,且未能主动调整输出分布。为此,我们提出Gambit,一种执行‘思维级束搜索’的推理算法。该方法定期修剪低质量轨迹,并从高质量前缀立即分支,通过轻量级评分器探测隐藏状态,动态将计算集中在最有希望的推理路径上,同时保持高硬件利用率。在多个模型与基准上的实证表明,Gambit严格优于现有基线:在相同硬件约束下,相较于剪枝基线,HMMT-24准确率最高提升6.7%,AIME-25提升3.3%;在轨迹补全任务中,吞吐量超过2倍;相比标准并行采样,总词元消耗减少最多达68.5%。

原文摘要 · Abstract (English)

Test-time compute scaling is a primary driver of performance in large reasoning models (LRMs), but extreme inefficiency bounds current approaches, shifting the critical question from \emph{how much} compute to spend, to \emph{where} to allocate it. We formalize test-time reasoning as a constrained compute allocation problem over partial trajectories. Under a fixed hardware budget, existing paradigms fail to actively allocate the compute to the most promising partial progress: traditional parallel sampling treats traces independently and induces severe memory bottlenecks, while subtractive pruning starves hardware and fails to actively and sufficiently shift the output distribution. To overcome this dichotomy, we introduce Gambit, an inference algorithm that executes \emph{thought-level beam search}. By periodically pruning unpromising trajectories and immediately branching from high-quality prefixes, Gambit dynamically concentrates compute onto the most promising reasoning traces via a light-weight scorer probing hidden states while maintaining continuous high hardware utilization. Extensive evaluations across multiple models and benchmarks demonstrate that Gambit strictly dominates existing baselines. Under identical hardware constraints, our method yields up to a +6.7\% absolute accuracy gain on HMMT-24 and +3.3\% on AIME-25 over pruning baselines, delivers $>2\times$ higher throughput on trace completion, and reduces total token consumption by up to 68.5\% relative to standard parallel sampling.

推理优化束搜索大模型计算分配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。