arXiv:2410.02217cs.LGcs.CV2024-10被引 14

将确定性流模型转为随机采样器,提升生成多样性与鲁棒性。

Stochastic Sampling from Deterministic Flow Models

  • 通过构建SDE家族,将确定性流模型扩展为连续的随机采样路径。
  • 在ImageNet上生成质量优于原确定性模型,且可调节采样多样性。
  • 适用于需灵活控制生成结果多样性的场景,如艺术创作、数据增强。

确定性流模型(如修正流)通过常微分方程(ODE)的向量场学习分布间的确定性映射,但对模型误差和离散化敏感,且无法基于中间状态生成不同样本,限制了应用。本文提出一种通用方法,将这类流模型的底层ODE转化为具有相同边缘分布的随机微分方程(SDE)族。该方法可在不重新训练的前提下,基于已有的流场与得分函数,构造一系列从确定性到随机采样的连续采样器。这些随机采样器引入额外自由度,缓解了确定性采样的缺陷,并在小规模高斯实验和大规模ImageNet生成任务中均表现更优。此外,该方法提供了调节生成多样性的新控制维度,实验中已实现定性验证。

原文摘要 · Abstract (English)

Deterministic flow models, such as rectified flows, offer a general framework for learning a deterministic transport map between two distributions, realized as the vector field for an ordinary differential equation (ODE). However, they are sensitive to model estimation and discretization errors and do not permit different samples conditioned on an intermediate state, limiting their application. We present a general method to turn the underlying ODE of such flow models into a family of stochastic differential equations (SDEs) that have the same marginal distributions. This method permits us to derive families of \emph{stochastic samplers}, for fixed (e.g., previously trained) \emph{deterministic} flow models, that continuously span the spectrum of deterministic and stochastic sampling, given access to the flow field and the score function. Our method provides additional degrees of freedom that help alleviate the issues with the deterministic samplers and empirically outperforms them. We empirically demonstrate advantages of our method on a toy Gaussian setup and on the large scale ImageNet generation task. Further, our family of stochastic samplers provide an additional knob for controlling the diversity of generation, which we qualitatively demonstrate in our experiments.

生成模型流模型随机采样图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。