提出快速求解高斯混合模型间扩散路径的新方法,无需训练。
Go With the Flow: Fast Diffusion for Gaussian Mixture Models
- 用线性规划替代传统优化,直接求解高斯混合模型间的扩散路径。
- 计算复杂度仅随混合成分数线性增长,支持高效多目标分布插值。
- 适用于图像隐空间转换、细胞动态建模等低中维问题,代码开源。
薛定谔桥(Schrodinger Bridges, SBs)是有限时间内将初始分布导向目标分布的扩散过程,同时最小化特定代价函数。尽管已有多种计算方法,但多数仍需昂贵的训练过程,即使在低维问题中亦然。本文提出一种解析参数化方案,用于在两个高斯混合模型(GMM)之间设计可行的控制策略。无需依赖非凸优化,最优策略可通过一个维度与混合成分数呈线性关系的低维线性规划求解。该方法可自然推广至可控线性时变系统,实现多边缘动量薛定谔桥在GMM间的高效求解,解决了一类挑战性的分布插值问题。我们在低至中等维度场景中验证了其有效性,包括自动编码器隐空间中的图像到图像转换、基于多边缘动量薛定谔桥的细胞动态学习等。代码已公开于 https://github.com/georgeRapa/GMMflow。
原文摘要 · Abstract (English)
Schrodinger Bridges (SBs) are diffusion processes that steer, in finite time, a given initial distribution to another final one while minimizing a suitable cost functional. Although various methods for computing SBs have recently been proposed in the literature, most of these approaches require computationally expensive training schemes, even for solving low-dimensional problems. In this work, we propose an analytic parametrization of a set of feasible policies for steering the distribution of a dynamical system from one Gaussian Mixture Model (GMM) to another. Instead of relying on standard non-convex optimization techniques, the optimal policy within the set can be approximated as the solution of a low-dimensional linear program whose dimension scales linearly with the number of components in each mixture. The proposed method generalizes naturally to more general classes of dynamical systems, such as controllable linear time-varying systems, enabling efficient solutions to multi-marginal momentum SBs between GMMs, a challenging distribution interpolation problem. We showcase the potential of this approach in low-to-moderate dimensional problems such as image-to-image translation in the latent space of an autoencoder, learning of cellular dynamics using multi-marginal momentum SBs, and various other examples. The implementation is publicly available at https://github.com/georgeRapa/GMMflow.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。