arXiv:2603.06666cs.CV2026-03被引 1

通过词组级验证加速自回归图像生成,提升速度且不损失质量

SJD-PV: Speculative Jacobi Decoding with Phrase Verification for Autoregressive Image Generation

  • 基于相邻视觉词元共现统计,构建语义连贯的词组单元
  • 在解码窗口内联合验证多个相关词元,减少函数调用30%
  • 无需训练,适用于各类自回归图文生成模型

自回归图像模型虽生成能力出色,但因序列化推理导致显著延迟。现有无训练加速方法通常独立验证词元,忽略了相邻视觉词元间的强共现模式,常引发上下文不一致并限制解码效率。本文提出一种新颖的无训练加速框架,实现词组级推测性验证,使模型在每个解码窗口内联合验证多个相关词元。为构建词组单元,我们分析训练语料中的词元共现统计,将频繁共现的词元聚类为语义连贯的视觉短语。推理时,该方法对每个词组计算聚合似然比,可同时接受多个词元,同时保持生成质量。在自回归文本到图像生成任务上的大量实验表明,该方法显著降低函数评估次数(NFE),实现最高达30%的解码加速,且未牺牲视觉保真度。研究发现,建模短程词元共现是加速自回归推理的有效通用原则。

原文摘要 · Abstract (English)

Autoregressive (AR) image models have recently demonstrated remarkable generative capability, but their sequential nature results in significant inference latency. Existing training-free acceleration methods typically verify tokens independently, overlooking the strong co-occurrence patterns between adjacent visual tokens. This independence assumption often leads to contextual inconsistency and limits decoding efficiency. In this work, we introduce a novel training-free acceleration framework that performs phrase-level speculative verification, enabling the model to jointly validate multiple correlated tokens within each decoding window. To construct such phrase units, we analyze token co-occurrence statistics from the training corpus and group frequently co-occurring tokens into semantically coherent visual phrases. During inference, the proposed phrase-level verification evaluates aggregated likelihood ratios over each phrase, allowing simultaneous acceptance of multiple tokens while preserving generation quality. Extensive experiments on autoregressive text-to-image generation show that our method significantly reduces the number of function evaluations (NFE) and achieves up to 30% faster decoding without compromising visual fidelity. Our findings reveal that modeling short-range token co-occurrence provides an effective and general principle for accelerating autoregressive inference.

自回归生成加速推理词组验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。