arXiv:2502.08005cs.LGcs.CV2025-02被引 7

无需教师模型监督,直接学习学生与数据分布的密度比以提升单步扩散生成质量。

DiffRatio: Training One-Step Diffusion Models Without Teacher Supervision

  • 直接估计学生与数据分布的密度比作为梯度,减少训练偏差。
  • 在CIFAR-10和ImageNet上生成质量优于多数依赖教师监督的方法。
  • 轻量级密度比网络降低计算开销,且可自然用于推理阶段并行加速。

基于分数的蒸馏方法(如变分分数蒸馏)通过先预训练教师分数模型,再将其蒸馏到单步学生模型来训练单步扩散模型。然而,蒸馏阶段的梯度估计通常受双重偏差影响:(1) 预训练中产生的分数估计误差导致教师监督偏差;(2) 蒸馏过程中学生模型自身的分数估计误差。为解决此问题,我们提出DiffRatio框架:不再分别估计教师与学生分数后取差值,而是直接学习学生分布与数据分布之间的对数密度比,作为跨扩散时间步的梯度。该方法显著简化训练流程,大幅降低梯度估计偏差,提升单步生成质量。此外,采用轻量级密度比网络替代两个完整分数网络,降低模型规模,提升计算与内存效率。DiffRatio在CIFAR-10和ImageNet(64x64与512x512)上实现具有竞争力的单步生成效果,超越多数教师监督蒸馏方法。同时,学习到的密度比可自然作为验证器,支持无外部奖励、无需额外序列计算的推理时并行扩展,进一步提升生成质量。

原文摘要 · Abstract (English)

Score-based distillation methods (e.g., variational score distillation) train one-step diffusion models by first pre-training a teacher score model and then distilling it into a one-step student model. However, the gradient estimator in the distillation stage usually suffers from two sources of bias: (1) biased teacher supervision due to score estimation error incurred during pre-training, and (2) the student model's score estimation error during distillation. These biases can degrade the quality of the resulting one-step diffusion model. To address this, we propose DiffRatio, a new framework for training one-step diffusion models: instead of estimating the teacher and student scores independently and then taking their difference, we directly estimate the score difference as the gradient of a learned log density ratio between the student and data distributions across diffusion time steps. This approach greatly simplifies the training pipeline, significantly reduces gradient estimation bias, and improves one-step generation quality. Additionally, it also reduces auxiliary network size by using a lightweight density-ratio network instead of two full score networks, which improves computational and memory efficiency. DiffRatio achieves competitive one-step generation results on CIFAR-10 and ImageNet (64x64 and 512x512), outperforming most teacher-supervised distillation methods. Moreover, the learned density ratio naturally serves as a verifier, enabling a principled inference-time parallel scaling scheme that further improves the generation quality without external rewards or additional sequential computation.

扩散模型单步生成密度比无教师蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。