arXiv:2607.06335cs.CV2026-07

用修复阶段连接剪枝与一步蒸馏,大幅降低扩散模型推理开销。

Bridging Diffusion Pruning and Step Distillation with Teacher-Aligned Repair

论文配图:Bridging Diffusion Pruning and Step Distillation with Teacher-Aligned Repair
图 1 · 摘自论文原文
  • 先剪枝再通过教师对齐修复,衔接剪枝与一步蒸馏
  • 20%剪枝后仅1次前向即可达FID 3.12,参数降至9882.6万
  • 适用于需快速生成且资源受限的图像生成场景

扩散模型生成高质量图像,但推理成本来自大容量去噪网络和重复去噪步骤。现有压缩方法通常分别处理这两方面:剪枝减少网络规模,但多数需长时重训练恢复多步采样器;一步蒸馏减少采样步数,但依赖学生模型已能较好跟随教师以获得有效梯度。本文探讨能否用一步蒸馏替代剪枝后的重训练。发现直接替换失败:剪枝EDM2-XS教师后,从剪枝检查点启动SiDA生成无效样本。为此提出短周期教师对齐修复阶段,将剪枝生成器在噪声真实图像潜在空间上匹配教师,再交由一步蒸馏。在ImageNet-512上,原EDM2-XS基线使用12471.3万参数和63次网络评估,FID为3.53。经合适蒸馏目标优化,20%剪枝的一步生成器仅用9882.6万参数和1次评估,FID达3.12;30%剪枝时参数降至8802.9万,一次评估下FID为4.26。

原文摘要 · Abstract (English)

Diffusion models generate high-quality images, but their inference cost comes from two sources: large denoising networks and repeated denoising steps. Existing compression pipelines usually attack these costs separately. Pruning reduces the network, but most pruning methods still rely on a long post-pruning retraining stage to recover a many-step sampler. Step distillation reduces the number of denoising steps, but it usually assumes a student that can already follow the teacher well enough to receive useful distillation gradients. This paper asks whether post-pruning retraining can be replaced by step distillation. We find that the direct replacement fails: after pruning an EDM2-XS teacher, starting SiDA from the pruned checkpoint produces unusable samples. We introduce a short teacher-alignment repair stage as a bridge between pruning and step distillation. The bridge matches the pruned generator to the teacher on noisy real-image latents, then hands the repaired checkpoint to one-step distillation. On ImageNet-512, the original EDM2-XS baseline uses 124.713M parameters and 63 network evaluations, reaching an FID of 3.53. With a suitable distillation objective, our 20% pruned one-step generator uses 98.826M parameters and one network evaluation, reaching an FID of 3.12. With 30% pruning, the model uses 88.029M parameters and one network evaluation, with an FID of 4.26.

扩散模型模型剪枝一步生成高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。