提出强随机流映射,实现扩散模型的少步采样。
Strong Stochastic Flow Maps

- 直接学习含噪SDE的强解映射,突破传统方法仅弱收敛限制。
- 引入多项式逼近布朗运动,实现路径一致收敛,支持无模拟训练。
- 在图像生成与分子系统模拟中实现少步采样,性能超越现有方法。
流模型与扩散模型在多种模态下可生成高质量样本;然而,推理时需多次网络评估以数值积分底层微分方程。流映射通过直接学习微分方程的解映射,实现少步采样。但现有方法仅能近似常微分方程(ODE)的解映射,用于随机微分方程(SDE)时,仅恢复过程的边际分布(弱收敛),而非路径(强收敛)。本文提出强随机流映射(SSFMs),作为学习加性噪声SDE强解映射的新框架,直接将确定性流映射推广至随机场景。进一步,提出布朗运动的多项式逼近,并证明其路径一致收敛。该结果支持无需模拟的解映射训练目标。实验表明,SSFMs在图像生成上优于先前的随机流映射方法,并实现分子系统的少步采样。
原文摘要 · Abstract (English)
Flow and diffusion models generate high-quality samples in many modalities; however, many network evaluations are required during inference due to numerical integration of an underlying differential equation. Flow maps alleviate this problem by learning the solution map of the differential equation directly, enabling few-step sampling. Yet, current methods are restricted to approximating the solution map of ODEs. These methods can be used to learn the transition kernel of an SDE, thereby obtaining a solution map that recovers the marginal distributions of the process (weak convergence) rather than the solution path (strong convergence). We propose Strong Stochastic Flow Maps (SSFMs) as a novel framework for learning the strong solution map of additive-noise SDEs, directly generalizing deterministic flow maps to the stochastic setting. Further, a polynomial approximation to Brownian motion is introduced and shown to converge pathwise. These results enable a simulation-free training objective for the solution map of diffusion models. We demonstrate that SSFMs outperform previous stochastic flow map methods on image generation and enable few-step sampling of molecular systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。