arXiv:2603.27115cs.CV2026-03被引 1

通过预测验证通过的候选词提升采样效率,加速图像生成

SJD-VP: Speculative Jacobi Decoding with Verification Prediction for Autoregressive Image Generation

  • 利用概率上升的词更可能通过验证的规律引导采样
  • 在多个基准上实现更快生成且图像质量更好
  • 可无缝接入现有方法,无需修改核心结构

推测性雅可比解码(SJD)已成为加速自回归图像生成的有前景方法。尽管潜力巨大,现有SJD方法常因推测词选择模糊导致接受率低。近期工作主要从放宽验证角度缓解此问题,但未充分挖掘解码的迭代动态特性。本文深入分析后发现:概率上升的词更可能被验证通过并正确。基于此,提出推测性雅可比解码与验证预测(SJD-VP)。核心思想是利用词概率在迭代间的变动趋势指导采样,优先选择概率上升的词,从而有效预测后续验证通过的可能性,提升接受率。SJD-VP为即插即用设计,可无缝集成至现有SJD方法。大量实验表明,该方法在标准基准上持续加速自回归解码,同时改善图像生成质量。

原文摘要 · Abstract (English)

Speculative Jacobi Decoding (SJD) has emerged as a promising method for accelerating autoregressive image generation. Despite its potential, existing SJD approaches often suffer from the low acceptance rate issue of speculative tokens due to token selection ambiguity. Recent works attempt to mitigate this issue primarily from the relaxed token verification perspective but fail to fully exploit the iterative dynamics of decoding. In this paper, we conduct an in-depth analysis and make a novel observation that tokens whose probabilities increase are more likely to match the verification-accepted and correct token. Based on this, we propose a novel Speculative Jacobi Decoding with Verification Prediction (SJD-VP). The key idea is to leverage the change in token probabilities across iterations to guide sampling, favoring tokens whose probabilities increase. This effectively predicts which tokens are likely to pass subsequent verification, boosting the acceptance rate. In particular, our SJD-VP is plug-and-play and can be seamlessly integrated into existing SJD methods. Extensive experiments on standard benchmarks demonstrate that our SJD-VP method consistently accelerates autoregressive decoding while improving image generation quality.

图像生成自回归加速推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。