arXiv:2510.24211cs.CV2025-10中稿 · ICML被引 4

无需训练即可加速自回归视觉生成,速度最高提升13.6倍

Speculative Coupled Decoding for Training-Free Lossless Acceleration of Autoregressive Visual Generation

  • 通过耦合机制稳定生成过程,提升草案接受率
  • 图像生成快4.2倍,视频生成快13.6倍,质量无损
  • 仅需一行代码修改,零训练成本,适合部署优化

自回归(AR)视觉生成虽前景广阔,但因逐标记生成导致推理极慢,常需数千步完成单样本生成。现有推测解码(SD)方法虽可提速,但存在加速有限、质量下降或需训练草稿模型的问题。本文提出无需训练、无损的推测耦合解码(SCD),基于最近提出的推测雅可比解码(SJD)。我们发现SJD因独立采样导致轨迹不稳,接受率受限。为此引入信息论耦合机制,最大化连续迭代中生成相同草案标记的概率,显著提升接受率并保持无损特性。该方法仅需一行代码修改,几乎无额外开销,实现图像生成最高4.2倍、视频生成最高13.6倍的加速,且不降质。代码已开源。

原文摘要 · Abstract (English)

Autoregressive (AR) modeling has recently emerged as a promising new paradigm in visual generation, but its practical adoption is severely constrained by the slow inference speed of per-token generation, which often requires thousands of steps to produce a single sample. While several Speculative Decoding (SD)-based methods have been proposed to solve this problem by generating multiple tokens in a single forward step, they suffer from limited speedup, degraded quality, or require the training of a draft model. To solve these problems, we propose a new training-free, lossless SD framework, Speculative Coupled Decoding (SCD), by extending the recently proposed Speculative Jacobi Decoding (SJD). While SJD shows strong potential for accelerating AR generation by combining Jacobi iteration and SD, we found that its acceptance rate is still significantly limited due to the instability arising from the independent sampling process used during draft token generation. To overcome this, we introduce an information-theoretic approach, Coupling, which stabilizes the drafting trajectory of SJD by maximizing the probability of sampling identical draft tokens across consecutive iterations, significantly enhancing the acceptance rate while preserving its lossless property. Remarkably, this method requires only a single-line modification to the existing algorithm with almost zero overhead, yet achieves substantial performance gains, delivering up to a 4.2x speedup in image generation and 13.6x speedup in video generation compared to standard AR decoding, without any degradation or the need for additional training. The source code is available at https://github.com/junhyukso/SCD

自回归生成推测解码加速推理无损加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。