通过分步前瞻推理,让思维模型生成更快更准的推理结果。
Scaling Speculative Decoding with Lookahead Reasoning
- 用轻量模型预测多个未来推理步骤,批量验证并修正错误。
- 在GSM8K等数据集上将生成速度提升从1.4倍提高到2.1倍。
- 适合需要高速推理且对准确率要求高的复杂任务场景。
推理模型通过生成长链式思维表现出色,但解码数千个词元的过程十分缓慢。基于词元的推测解码(SD)虽可加速,但其增益受限:当猜测长度γ增大时,整个γ词元预测正确的概率呈指数下降,导致分配更多算力也无法突破算法瓶颈,提速有限且与硬件无关。本文提出前瞻推理(Lookahead Reasoning),利用第二层步骤级并行性打破这一天花板。核心思想是:推理模型按步骤生成,每个步骤只需语义正确而非精确匹配。轻量级草稿模型预测多个未来步骤,目标模型批量展开每项提议,验证器保留语义正确的步骤,失败则由目标模型重生成。词元级推测解码仍在每个推理步骤内运行,两层并行性叠加放大效果。理论与实证均证明,前瞻推理显著提升推测解码峰值速度。在GSM8K、AIME等基准测试中,将速度提升从1.4倍增至2.1倍,同时保持答案质量,并随额外GPU算力更好扩展。代码已开源。
原文摘要 · Abstract (English)
Reasoning models excel by generating long chain-of-thoughts, but decoding the resulting thousands of tokens is slow. Token-level speculative decoding (SD) helps, but its benefit is capped, because the chance that an entire $γ$-token guess is correct falls exponentially as $γ$ grows. This means allocating more compute for longer token drafts faces an algorithmic ceiling -- making the speedup modest and hardware-agnostic. We raise this ceiling with Lookahead Reasoning, which exploits a second, step-level layer of parallelism. Our key insight is that reasoning models generate step-by-step, and each step needs only to be semantically correct, not exact token matching. In Lookahead Reasoning, a lightweight draft model proposes several future steps; the target model expands each proposal in one batched pass, and a verifier keeps semantically correct steps while letting the target regenerate any that fail. Token-level SD still operates within each reasoning step, so the two layers of parallelism multiply. We show Lookahead Reasoning lifts the peak speedup of SD both theoretically and empirically. Across GSM8K, AIME, and other benchmarks, Lookahead Reasoning improves the speedup of SD from 1.4x to 2.1x while preserving answer quality, and its speedup scales better with additional GPU throughput. Our code is available at https://github.com/hao-ai-lab/LookaheadReasoning
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。