2步生成图像质量逼近8步,靠三招优化蒸馏策略。
High-Fidelity Two-Step Image Generation via Teacher-Aligned End-to-End Distillation

- 用教师生成图替代真实图做对抗训练,目标更精准。
- 两步去噪用独立参数,适配不同步骤的能力需求。
- 端到端迭代正则训练,兼顾最终质量与中间结果。
少步扩散蒸馏在4-8步生成上已较成熟,但推进至2步仍具挑战。本文提出Z-Image Turbo++,一个从8步教师模型Z-Image Turbo蒸馏而来的高质量2步图像生成模型。针对2步生成中任务难度增加与模型容量有限的核心瓶颈,我们设计了三项简单却有效的方案:首先,提出分布对齐对抗学习,使用教师生成图像而非外部真实图像作为GAN训练的真实样本,提供更可行且信息量更高的对抗目标;其次,采用步解耦参数化,为两个去噪步骤分配独立模型参数,更好匹配其不同的容量需求;第三,实施带迭代正则的端到端训练,使第一步能接收最终图像质量的梯度,同时通过显式第一步损失保留有意义的中间生成。三者结合显著缩小了2步与8步生成在定性与定量评估中的质量差距,凸显了针对性蒸馏策略在提升少步生成质量-效率平衡方面的潜力。
原文摘要 · Abstract (English)
Few-step diffusion distillation has become increasingly mature for 4-8-step generation, yet pushing further to 2 steps remains challenging. In this work, we introduce Z-Image Turbo++, a high-quality 2-step image generation model distilled from the 8-step Z-Image Turbo teacher. Our method addresses the central bottlenecks of increased task difficulty and limited model capacity in 2-step generation through three simple but effective design choices tailored to this regime. First, we propose Distribution-Aligned Adversarial Learning, which uses teacher-generated images rather than external real images as real samples for GAN training, providing a more attainable and informative adversarial target. Second, we adopt Step-Decoupled Parameterization, assigning independent model parameters to the two denoising steps to better match their distinct capacity demands. Third, we perform End-to-End Training with Iterative Regularization, allowing the first step to receive gradients from final image quality while preserving a meaningful intermediate generation through an explicit step-1 loss. Together, these designs substantially narrow the quality gap between 2-step and 8-step generation in both qualitative and quantitative evaluations, highlighting the potential of carefully tailored distillation strategies for improving the quality-efficiency trade-off in few-step generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。