统一扩散桥问题框架,整合流匹配与薛定谔桥算法
A Unified Framework for Diffusion Bridge Problems: Flow Matching and Schrödinger Matching into One
- 提出统一框架,将多种桥问题算法纳入同一理论体系
- 可推导出流匹配、薛定谔桥匹配等经典算法作为特例
- 适合从事生成模型、概率建模的研究者参考
桥问题旨在寻找一个随机微分方程(或有时为常微分方程)来连接两个给定分布。该问题应用广泛,尤其在生成建模(如条件或无条件图像生成)中最为突出。著名的薛定谔桥问题作为百年经典问题,是桥问题的特例。深度学习时代,解决桥问题的两类主流算法为(条件)流匹配和迭代拟合算法,前者局限于常微分方程解,后者专用于薛定谔桥问题。本文贡献有二:其一,对这些算法提供技术细节的简洁综述;其二,提出一种新颖的统一视角与框架,将看似无关的算法及其变体统一于一。特别地,我们证明该框架可实例化为流匹配(FM)、小批量最优传输流匹配、小批量薛定谔桥流匹配以及深度薛定谔桥匹配(DSBM)算法。
原文摘要 · Abstract (English)
The bridge problem is to find an SDE (or sometimes an ODE) that bridges two given distributions. The application areas of the bridge problem are enormous, among which the recent generative modeling (e.g., conditional or unconditional image generation) is the most popular. Also the famous Schrödinger bridge problem, a widely known problem for a century, is a special instance of the bridge problem. Two most popular algorithms to tackle the bridge problems in the deep learning era are: (conditional) flow matching and iterative fitting algorithms, where the former confined to ODE solutions, and the latter specifically for the Schrödinger bridge problem. The main contribution of this article is in two folds: i) We provide concise reviews of these algorithms with technical details to some extent; ii) We propose a novel unified perspective and framework that subsumes these seemingly unrelated algorithms (and their variants) into one. In particular, we show that our unified framework can instantiate the Flow Matching (FM) algorithm, the (mini-batch) optimal transport FM algorithm, the (mini-batch) Schrödinger bridge FM algorithm, and the deep Schrödinger bridge matching (DSBM) algorithm as its special cases. We believe that this unified framework will be useful for viewing the bridge problems in a more general and flexible perspective, and in turn can help researchers and practitioners to develop new bridge algorithms in their fields.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。