arXiv:2603.19570cs.CV2026-03

通过多尺度采样与单步蒸馏,让图像扩散解码快10倍且质量不降。

Accelerating Diffusion Decoders via Multi-Scale Sampling and One-Step Distillation

  • 分阶段从粗到细逐步提升分辨率,理论提速近对数级
  • 每阶段用单步去噪模型替代迭代过程,实现一次前向传播完成重建
  • 适合需要实时或大规模图像重构的场景,如视频生成、端侧部署

图像标记化在现代生成建模中至关重要,它将视觉输入映射为紧凑的潜在表示,作为像素与生成模型之间的中间信号。基于扩散的解码器最近被用于从潜在表示中高保真地重建图像。与用于下游生成的扩散模型不同,这些解码器专注于忠实还原而非内容生成。然而,其迭代采样过程导致显著延迟,难以应用于实时或大规模场景。本文提出一种两阶段加速框架:首先采用多尺度采样策略,从粗分辨率开始,每阶段分辨率翻倍,相比全分辨率标准采样实现理论上的 $/mathcal{O}(/log n)$ 速度提升;其次,将每个尺度的扩散解码器蒸馏为单步去噪模型,使每尺度仅需一次前向传播即可完成高质量重建。该方法实现解码时间数量级降低,输出质量几乎无损。本工作为高效且表达力强的图像标记化提供了可行路径,有望成为未来高效视觉标记化与下游生成研究的基础。

原文摘要 · Abstract (English)

Image tokenization plays a central role in modern generative modeling by mapping visual inputs into compact representations that serve as an intermediate signal between pixels and generative models. Diffusion-based decoders have recently been adopted in image tokenization to reconstruct images from latent representations with high perceptual fidelity. In contrast to diffusion models used for downstream generation, these decoders are dedicated to faithful reconstruction rather than content generation. However, their iterative sampling process introduces significant latency, making them impractical for real-time or large-scale applications. In this work, we introduce a two-stage acceleration framework to address this inefficiency. First, we propose a multi-scale sampling strategy, where decoding begins at a coarse resolution and progressively refines the output by doubling the resolution at each stage, achieving a theoretical speedup of $\mathcal{O}(\log n)$ compared to standard full-resolution sampling. Second, we distill the diffusion decoder at each scale into a single-step denoising model, enabling fast and high-quality reconstructions in a single forward pass per scale. Together, these techniques yield an order-of-magnitude reduction in decoding time with little degradation in output quality. Our approach provides a practical pathway toward efficient yet expressive image tokenizers. We hope it serves as a foundation for future work in efficient visual tokenization and downstream generation.

扩散模型图像重建加速推理多尺度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。