让扩散模型生成的草稿更连贯,提升大模型推理速度
xPress: Parallel Refinement for Diffusion Drafters in Speculative Decoding

- 用并行优化方法修复扩散草稿的因果依赖关系
- 在多个基准上平均提升30%接受长度,最高达56%
- 适合需要高速文本生成的场景,如对话系统
像dFlash这样的块扩散草稿生成器可在单次前向传播中生成一整块草稿令牌,显著降低多令牌草稿的开销。但其关键步骤是逐位置独立采样,导致草稿仅基于边际分布,缺乏前后依赖。这使得生成的序列虽单个词概率高,但整体不符合目标模型分布,易被早期拒绝,限制接受长度。为此,我们提出xPress,一种轻量级因果精炼器,通过并行方式一次性修正整个扩散块,恢复并传播草稿中的因果依赖,无需逐令牌循环。在Qwen3-8B上,七个数学、代码和聊天基准测试中,xPress平均使接受长度提升约30%(最高+56%),端到端解码吞吐量平均提升约1.3倍(最高达1.7倍),优于原始dFlash扩散草稿生成器。
原文摘要 · Abstract (English)
Block-diffusion drafters like dFlash generate an entire block of draft tokens in a single forward pass, drastically reducing the overhead of multiple-token drafting in speculative decoding. The crucial final step of the single-pass discrete denoising process involves using the logit distribution at each position to sample conditionally independent tokens. The resulting draft is thus a set of per-position marginals, rather than a joint distribution: no draft token is guaranteed to depend on its predecessors. Such independently sampled marginals tend to produce sequences with tokens that are individually likely, but jointly improbable under the target model's distribution, which verifies each token conditionally. This can cause early rejection and limits acceptance length. To address this, we propose xPress as a means to restore the missing causality in diffusion drafters. xPress is a lightweight causal refiner that reconciles the whole diffusion block at once through parallel refinement, restoring and propagating causal dependencies across the draft without a token-by-token loop. On Qwen3-8B, across seven math, code, and chat benchmarks, xPress raises acceptance length by about 30% on average (up to +56%) and its end-to-end decoding throughput by about 1.3 on average (up to 1.7) compared to the original dFlash diffusion drafter.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。