arXiv:2605.21484cs.CV2026-05

用固定点迭代实现单步蒸馏,让图像生成快又准。

One-Step Distillation of Discrete Diffusion Image Generators via Fixed-Point Iteration

论文配图:One-Step Distillation of Discrete Diffusion Image Generators via Fixed-Point Iteration
图 1 · 摘自论文原文
  • 通过部分破坏学生模型的单步生成结果,用教师模型一次修正。
  • 单步推理即达接近多步教师的图像质量和结构对齐效果。
  • 支持无条件对抗损失提升视觉真实感,适合快速生成场景。

离散扩散模型在图像合成上表现优异,但依赖缓慢的迭代解码。现有单步蒸馏方法或需额外训练评分网络(计算量翻倍),或引入专用参数化与多阶段流程,导致优化碎片化。本文提出固定点蒸馏(FPD),一种端到端框架:通过部分破坏学生模型的单步草稿,再以一次教师步骤进行修正,构建局部校正目标。为在语义有意义空间中计算训练目标,将离散标记映射至连续特征,并采用多带宽漂移损失,逐步累积修正。为穿透离散瓶颈反向传播梯度,使用直通估计器,在前向过程中将精确硬采样标记输入教师与解码器,确保训练与推理共享同一码本流形,同时将连续梯度回传至学生输出。该全可微路径还支持可选的无条件对抗目标,增强感知真实感。在类别与文本条件生成任务上的评估验证了框架有效性。FPD 在单步推理下达到竞争性视觉保真度与结构对齐,显著缩小与多步教师的差距,并优于现有离散蒸馏基线。

原文摘要 · Abstract (English)

Discrete diffusion models excel at visual synthesis but rely on slow, iterative decoding. Existing single-step distillation methods attempt to bypass this bottleneck, either by training auxiliary score networks that effectively double compute, or by introducing specialized parameterizations and multi-stage pipelines that fragment optimization. In this paper, we introduce Fixed-Point Distillation (FPD), an end-to-end framework that constructs local correction targets by partially corrupting the student's one-step draft and refining it with a single teacher step. To compute the training objective in a semantically meaningful space, we lift discrete tokens into continuous features and apply a multi-bandwidth drift loss that iteratively accumulates these corrections. To backpropagate through the discrete bottleneck, we employ a straight-through estimator that feeds exact hard-sampled tokens to the teacher and decoder during the forward pass, ensuring that training and inference operate on the same codebook manifold, while routing continuous gradients back to the student logits. This fully differentiable pathway additionally accommodates an optional unconditional adversarial objective to enhance perceptual realism. Evaluations on both class- and text-conditional generation validate the effectiveness of our framework. FPD achieves competitive visual fidelity and structural alignment within a single inference step, narrowing the gap to multi-step teachers while outperforming existing discrete distillation baselines.

图像生成扩散模型蒸馏单步推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。