arXiv:2510.21003cs.LG2025-10NeurIPS被引 4

让图像自回归模型一步生成,速度提升12倍且质量损失极小。

Distilled Decoding 2: One-step Sampling of Image Auto-regressive Models with Conditional Score Distillation

  • 用条件得分蒸馏训练单步生成器,无需预设映射关系。
  • ImageNet-256上FID仅从3.40升至5.43,性能接近原模型。
  • 适合追求快速高质量图像生成的研究与应用开发者。

图像自回归(AR)模型虽性能出色,但生成速度慢,因需大量采样步数。尽管已有Distilled Decoding 1(DD1)实现少步采样,其在单步设置下仍存在显著性能下降,且依赖预定义映射,灵活性受限。本文提出新方法DD2,进一步推动单步采样可行性。不同于DD1,DD2不依赖预定义映射,将原AR模型视为教师模型,在每个标记位置提供潜在空间中的真实条件得分。基于此,设计新型条件得分蒸馏损失,训练独立网络预测生成分布的条件得分,并在每一步基于前序标记进行得分蒸馏。实验表明,DD2实现图像AR模型单步采样,ImageNet-256上FID仅由3.40增至5.43。相比最强基线DD1,DD2将单步采样与原始AR模型的差距缩小67%,同时实现最高12.3倍的训练加速。该工作为单步自回归生成迈出关键一步,开启快速高质量建模新可能。代码已开源。

原文摘要 · Abstract (English)

Image Auto-regressive (AR) models have emerged as a powerful paradigm of visual generative models. Despite their promising performance, they suffer from slow generation speed due to the large number of sampling steps required. Although Distilled Decoding 1 (DD1) was recently proposed to enable few-step sampling for image AR models, it still incurs significant performance degradation in the one-step setting, and relies on a pre-defined mapping that limits its flexibility. In this work, we propose a new method, Distilled Decoding 2 (DD2), to further advances the feasibility of one-step sampling for image AR models. Unlike DD1, DD2 does not without rely on a pre-defined mapping. We view the original AR model as a teacher model which provides the ground truth conditional score in the latent embedding space at each token position. Based on this, we propose a novel \emph{conditional score distillation loss} to train a one-step generator. Specifically, we train a separate network to predict the conditional score of the generated distribution and apply score distillation at every token position conditioned on previous tokens. Experimental results show that DD2 enables one-step sampling for image AR models with an minimal FID increase from 3.40 to 5.43 on ImageNet-256. Compared to the strongest baseline DD1, DD2 reduces the gap between the one-step sampling and original AR model by 67%, with up to 12.3$\times$ training speed-up simultaneously. DD2 takes a significant step toward the goal of one-step AR generation, opening up new possibilities for fast and high-quality AR modeling. Code is available at https://github.com/imagination-research/Distilled-Decoding-2.

图像生成自回归模型单步采样得分蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。