arXiv:2011.13456cs.LGstat.ML2020-11ICLR被引 11.9k

用随机微分方程实现从噪声生成数据,提升图像生成质量与效率。

Score-Based Generative Modeling through Stochastic Differential Equations

论文配图:Score-Based Generative Modeling through Stochastic Differential Equations
图 1 · 摘自论文原文
  • 通过正向加噪和反向去噪的随机微分方程建模数据分布变化
  • 在CIFAR-10上达到9.89的Inception分数和2.20的FID,生成1024×1024高清图像
  • 支持图像修复、着色等逆问题求解,适合高质量图像生成研究

从数据中生成噪声很容易;但从噪声生成数据则是生成建模的核心。我们提出一种随机微分方程(SDE),通过逐步注入噪声,将复杂的数据分布平滑地转化为已知的先验分布;同时,对应的反向时间SDE可逐步去除噪声,将先验分布还原为数据分布。关键在于,反向SDE仅依赖于扰动数据分布的时间相关梯度场(即得分)。借助得分估计的最新进展,我们可通过神经网络准确估计这些得分,并使用数值SDE求解器生成样本。该框架涵盖了此前得分生成建模和扩散概率建模的方法,支持新的采样流程与建模能力。我们引入预测-校正框架以修正离散化反向SDE中的误差,并推导出等价的神经ODE,可在相同分布下采样,同时实现精确似然计算和更高效的采样。此外,我们提出了基于得分模型求解逆问题的新方法,在类别条件生成、图像修复和着色任务中验证有效。结合多种架构改进,我们在无条件图像生成上取得突破:CIFAR-10上获得9.89的Inception分数、2.20的FID,以及2.99 bits/dim的竞争力似然,并首次实现1024×1024图像的高保真生成。

原文摘要 · Abstract (English)

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting noise, and a corresponding reverse-time SDE that transforms the prior distribution back into the data distribution by slowly removing the noise. Crucially, the reverse-time SDE depends only on the time-dependent gradient field (\aka, score) of the perturbed data distribution. By leveraging advances in score-based generative modeling, we can accurately estimate these scores with neural networks, and use numerical SDE solvers to generate samples. We show that this framework encapsulates previous approaches in score-based generative modeling and diffusion probabilistic modeling, allowing for new sampling procedures and new modeling capabilities. In particular, we introduce a predictor-corrector framework to correct errors in the evolution of the discretized reverse-time SDE. We also derive an equivalent neural ODE that samples from the same distribution as the SDE, but additionally enables exact likelihood computation, and improved sampling efficiency. In addition, we provide a new way to solve inverse problems with score-based models, as demonstrated with experiments on class-conditional generation, image inpainting, and colorization. Combined with multiple architectural improvements, we achieve record-breaking performance for unconditional image generation on CIFAR-10 with an Inception score of 9.89 and FID of 2.20, a competitive likelihood of 2.99 bits/dim, and demonstrate high fidelity generation of 1024 x 1024 images for the first time from a score-based generative model.

生成模型扩散模型SDE图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。