arXiv:2608.11742cs.CL2026-08

通过提前确定关键位置,实现扩散模型推理速度提升18倍

Ripple-Pivot Search: Active Parallel Decoding for Diffusion Large Language Models

论文配图:Ripple-Pivot Search: Active Parallel Decoding for Diffusion Large Language Models
图 1 · 摘自论文原文
  • 发现解码中'涟漪效应':提前确认中间熵位置可降低整体不确定性
  • 提出RPS方法,在4个基准上实现4-10倍加速,最高提速18倍
  • 无需训练,适合追求高吞吐的生成应用,尤其代码与推理任务

扩散大语言模型(dLLMs)作为自回归模型的有力替代,可通过并行解码实现显著更快的推理。现有并行解码调度器通常仅在满足逐位置条件后才固定位置,忽略了早期承诺对后续解码的潜在益处。我们发现了dLLM解码中的‘涟漪效应’:主动承诺一个中等熵的枢纽位置,可显著降低剩余掩码位置的不确定性。这一不确定性下降使后续步骤能并行解码更多标记,从而加速整体过程。为此,我们提出无需训练的Ripple-Pivot Search(RPS)方法,通过前瞻评估选择中等熵位置作为候选枢纽,并确定能带来最大下游收益的标记赋值。在3个dLLMs和4个推理与代码生成基准上,RPS相比标准解码器实现4-10倍的时钟速度提升,同时保持生成质量;相比先前的前瞻基线,准确率最高提升5.49%,且多数场景下吞吐更高。当结合KV缓存使用时,RPS进一步实现最高18倍的时钟速度提升。

原文摘要 · Abstract (English)

Diffusion Large Language Models (dLLMs) have emerged as a competitive alternative to autoregressive language models, offering the potential for substantially faster inference through parallel decoding. Existing parallel decoding schedulers typically commit positions only after they meet a per-position criterion, overlooking how early commitments may benefit subsequent decoding. We identify a ripple effect in dLLM decoding: proactively committing a mid-entropy pivot position can induce a pronounced reduction in uncertainty across the remaining masked positions. This uncertainty reduction allows subsequent steps to unmask more tokens in parallel, thereby accelerating the overall decoding process. To exploit the ripple effect, we propose Ripple-Pivot Search (RPS), a novel training-free decoding method that seeks mid-entropy positions as promising candidate pivots (where to decode), and determines their token assignment that yields the greatest downstream benefit via lookahead evaluation (what to decode). Across 3 dLLMs and 4 reasoning and code-generation benchmarks, RPS achieves 4-10$\times$ wall-clock speedup over the standard decoder while preserving generation quality, and improves accuracy over the previous lookahead baseline by up to 5.49% while delivering higher throughput in most settings. When integrated with KV caching, RPS further achieves up to 18$\times$ wall-clock speedup over the standard decoder.

扩散模型并行解码推理加速大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。