用签名方法加速扩散模型,推理步数减少十倍
Sig-DEG for Distillation: Making Diffusion Models Faster and Lighter
- 基于随机微分方程的签名近似,重构扩散过程
- 推理仅需约100步,生成质量媲美原模型
- 适合部署在资源受限场景的高效生成应用
扩散模型在生成建模中表现卓越,但推理时计算开销大,通常需数千步离散化。为此,我们提出Sig-DEG(基于签名的微分方程生成器),一种新型蒸馏生成器,可对粗时间粒度下的反向扩散过程进行通用近似。受高阶随机微分方程(SDE)逼近启发,Sig-DEG利用部分签名高效总结子区间上的布朗运动,并采用循环结构实现对SDE解的精准全局逼近。蒸馏被建模为监督学习任务,训练时让Sig-DEG在粗时间网格上匹配细粒度扩散模型的输出。推理阶段,因部分签名项可精确模拟,无需精细布朗路径。实验表明,Sig-DEG在保持竞争力生成质量的同时,将推理步数降低一个数量级。结果验证了签名近似在高效生成建模中的有效性。
原文摘要 · Abstract (English)
Diffusion models have achieved state-of-the-art results in generative modelling but remain computationally intensive at inference time, often requiring thousands of discretization steps. To this end, we propose Sig-DEG (Signature-based Differential Equation Generator), a novel generator for distilling pre-trained diffusion models, which can universally approximate the backward diffusion process at a coarse temporal resolution. Inspired by high-order approximations of stochastic differential equations (SDEs), Sig-DEG leverages partial signatures to efficiently summarize Brownian motion over sub-intervals and adopts a recurrent structure to enable accurate global approximation of the SDE solution. Distillation is formulated as a supervised learning task, where Sig-DEG is trained to match the outputs of a fine-resolution diffusion model on a coarse time grid. During inference, Sig-DEG enables fast generation, as the partial signature terms can be simulated exactly without requiring fine-grained Brownian paths. Experiments demonstrate that Sig-DEG achieves competitive generation quality while reducing the number of inference steps by an order of magnitude. Our results highlight the effectiveness of signature-based approximations for efficient generative modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。