用物理启发方法加速扩散模型,无需合成数据即可高效蒸馏。
Physics Informed Distillation for Diffusion Models
- 将扩散模型视为微分方程系统,用学生模型求解其轨迹。
- 在CIFAR-10和ImageNet上性能接近最新蒸馏方法。
- 超参数影响可预测,无需生成合成数据,易用性强。
扩散模型近年来成为生成建模的强大工具,但其固有的迭代特性常导致图像生成速度慢,需多次模型评估。近期研究揭示了扩散模型与概率流常微分方程(ODE)之间的内在联系,使我们能够将扩散模型视为一个ODE系统。同时,物理信息神经网络(PINNs)已证明其通过隐式建模解来有效求解复杂微分方程的能力。基于这些基础洞察,我们提出物理信息蒸馏(PID),让学生模型代表教师扩散模型对应的ODE系统的解,遵循与PINNs相似的原理。在CIFAR-10和ImageNet 64x64上的实验表明,PID性能可与近期蒸馏方法媲美。值得注意的是,它表现出对方法特定超参数的可预测趋势,并在蒸馏过程中无需生成合成数据集,显著提升了其作为扩散模型蒸馏方法的易用性。代码与预训练检查点已在https://github.com/pantheon5100/pid_diffusion.git公开。
原文摘要 · Abstract (English)
Diffusion models have recently emerged as a potent tool in generative modeling. However, their inherent iterative nature often results in sluggish image generation due to the requirement for multiple model evaluations. Recent progress has unveiled the intrinsic link between diffusion models and Probability Flow Ordinary Differential Equations (ODEs), thus enabling us to conceptualize diffusion models as ODE systems. Simultaneously, Physics Informed Neural Networks (PINNs) have substantiated their effectiveness in solving intricate differential equations through implicit modeling of their solutions. Building upon these foundational insights, we introduce Physics Informed Distillation (PID), which employs a student model to represent the solution of the ODE system corresponding to the teacher diffusion model, akin to the principles employed in PINNs. Through experiments on CIFAR 10 and ImageNet 64x64, we observe that PID achieves performance comparable to recent distillation methods. Notably, it demonstrates predictable trends concerning method-specific hyperparameters and eliminates the need for synthetic dataset generation during the distillation process. Both of which contribute to its easy-to-use nature as a distillation approach for Diffusion Models. Our code and pre-trained checkpoint are publicly available at: https://github.com/pantheon5100/pid_diffusion.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。