解决扩散模型压缩中引导效果失效问题,提升小型模型生成质量。
DASH: Dual-Branch Score Distillation for Guidance-Calibrated Compact Diffusion Models

- 分离监督条件与无条件分支,避免预测坍塌
- 压缩5倍后仍保持接近教师模型的生成质量
- 适合需要高效生成的部署场景
类条件扩散模型的参数压缩暴露了输出级蒸馏的结构性缺陷:仅监督带引导输出会导致两个得分分支无法区分,使学生模型无法确定分类器自由引导差距。零损失集合允许退化解,即两个分支都坍缩为相同预测,导致推理时引导失效,尽管训练损失很低。对于每个固定输入,目标函数在残差值任意处沿分支输出方向完全平坦,表明歧义是输出级目标的固有属性,而非局部最优解。本文提出DASH,独立监督条件与无条件分支。通过锚定项将条件预测正则化至真实噪声,并将教师模型每步学习的课程作为冻结先验传递给学生。在CIFAR-10、CIFAR-100和类条件ImageNet-64上,压缩超过5倍的学生模型与教师模型的FID差距不超过4点,恢复至少89%的教师引导差距幅度,而其他双分支基线方法最大仅达82%。消融实验表明,无条件监督是该方法与输出级蒸馏的关键区别。定量分析显示,零空间决定了复合学生模型两分支误差比,实测比值在三个数据集上均与预测一致。
原文摘要 · Abstract (English)
Parameter compression of class-conditional diffusion models exposes a structural limitation in output-level distillation: supervising only the guided output leaves the two score branches non-identifiable, so the classifier-free guidance gap is not determined in the student. The zero-loss set admits degenerate solutions in which both branches collapse toward identical predictions, and guidance loses its effect at inference despite low training loss. For each fixed input the objective is exactly flat in a branch-output direction at every residual value, so the ambiguity is a property of the output-level objective rather than a poor local minimum. This paper introduces DASH, which supervises the conditional and unconditional branches independently. An anchor term regularises the conditional prediction toward ground-truth noise, and the teacher's final learned per-timestep curriculum transfers into the student as a frozen prior. Across CIFAR-10, CIFAR-100, and class-conditional ImageNet-64, a more than 5x compressed student stays within four FID points of its teacher and recovers at least 89% of the teacher's guidance-gap magnitude, where no other two-branch baseline with defined calibration exceeds 82%. Ablation isolates unconditional supervision as the term that separates this formulation from output-level distillation. The account is quantitative: the null space fixes the ratio between a composite student's two branch errors, and the measured ratios approximately match that prediction on all three datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。