arXiv:2607.17652cs.AI2026-07

让扩散语言模型的块间解码并行,提速近4倍且不降准确率。

FlowBlock: Wavefront-Parallel Decoding for Self-Correcting Diffusion Language Models

论文配图:FlowBlock: Wavefront-Parallel Decoding for Self-Correcting Diffusion Language Models
图 1 · 摘自论文原文
  • 用动态波前机制允许块在满足条件时并行解码,保留缓存复用优势。
  • 在多个基准上实现最高4.01倍吞吐提升,延迟降低77.1%,准确率还提高1.3点。
  • 无需训练,适合追求高吞吐与低延迟的部署场景,如实时生成服务。

块级扩散大语言模型(dLLMs)以块为单位串行解码,虽能有效复用键值缓存(KV-cache),但块间解码严格串行。现有工作尝试通过后训练方法实现块间并行,但加速有限且常损害精度。我们观察到自修正扩散模型提供免训练方案:逐标记编辑(T2T)可修复因上游上下文稍旧而生成的错误标记,使下游块只需一个信息性草稿而非完整前驱。这将块终态从硬依赖转为调度资源。本文提出 extbf{ lowblock{}},一种基于两项机制的免训练并行解码框架:(i) 门控波前解码,在就绪门满足时将块纳入有限波前,联合通过T2T编辑优化活跃块,并在窗口化块因果掩码下有序提交,保持冻结前缀缓存复用;(ii) 异构波前打包,为每请求分配独立波前,将异步窗口密集打包为形状稳定的批量前向。在多个基准上, lowblock{}相比序列块式模型LLaDA-2.1和LLaDA-2.0,最大提升达2.95×和4.01×的每秒词元数(TPS),延迟分别降低53.6%和77.1%,平均准确率提升1.3点。相较基于训练的基线D2F, lowblock{}精度更高,批量服务吞吐最高达16×提升。

原文摘要 · Abstract (English)

Block-wise diffusion large language models (dLLMs) decode sequentially at the block level, enabling effective KV-cache reuse across blocks but making inter-block decoding strictly serial. Prior work has attempted to unlock inter-block parallelism through post-training methods, but achieves only modest speedups and often degrades accuracy. We observe that self-correcting dLLMs offer a training-free alternative: token-to-token (T2T) editing can repair tokens drafted with a slightly stale upstream context, so a downstream block requires only an informative draft rather than a finalized predecessor. This turns block finality from a hard dependency into a scheduling resource. We propose \textbf{\flowblock{}}, a training-free parallel decoding framework built on two mechanisms. (i) \emph{Gated Wavefront Decoding} admits blocks into a bounded wavefront only when a readiness gate is satisfied, jointly refines active blocks via T2T editing, and commits blocks in order under a windowed block-causal mask that preserves exact frozen-prefix KV caches reuse. (ii) \emph{Heterogeneous Wavefront Packing} assigns each request an independent wavefront while packing asynchronous windows into dense, shape-stable batched forwards. Across different benchmarks, \flowblock{} improves tokens per second (TPS) over LLaDA-2.1 and LLaDA-2.0, two serial block-wise dLLMs, by up to 2.95$\times$ and 4.01$\times$, while reducing latency by up to 53.6\% and 77.1\%, respectively. It also improves average accuracy by 1.3 points. Compared with D2F, a training-based inter-block-parallel baseline, \flowblock{} achieves higher accuracy and up to 16$\times$ higher batched serving throughput.

扩散模型并行解码推理优化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。