揭示修正流与最优传输的深层关系,澄清其适用边界。
On the Relation between Rectified Flows and Optimal Transport
- 提出修正流的不变性性质与显式速度场构造
- 证明梯度约束下的修正流仅在强假设下等价于最优传输
- 给出反例,否定以往声称的普遍等价性
本文研究修正流、流匹配与最优传输之间的联系。流匹配通过估计从源分布到目标分布的引导速度场来学习生成模型。修正流匹配旨在拉直学习到的传输路径,获得更直接的分布间映射。本文第一项贡献是阐明修正流的不变性性质及显式速度场构造,并在高斯(非独立)和高斯混合设置下进行显式构建与分析,探讨其与最优传输的关系。第二项贡献针对近期观点——当修正流的速度场被限制为梯度时,可渐近求解最优传输问题——我们研究该问题解的存在性,表明其仅在远强于先前认知的假设下才与最优传输相关。特别地,我们提出了多个反例,推翻了文献中已有的等价结论,认为对修正流强制施加梯度约束,在一般情况下并非可靠计算最优传输映射的方法。
原文摘要 · Abstract (English)
This paper investigates the connections between rectified flows, flow matching, and optimal transport. Flow matching is a recent approach to learning generative models by estimating velocity fields that guide transformations from a source to a target distribution. Rectified flow matching aims to straighten the learned transport paths, yielding more direct flows between distributions. Our first contribution is a set of invariance properties of rectified flows and explicit velocity fields. In addition, we also provide explicit constructions and analysis in the Gaussian (not necessarily independent) and Gaussian mixture settings and study the relation to optimal transport. Our second contribution addresses recent claims suggesting that rectified flows, when constrained such that the learned velocity field is a gradient, can yield (asymptotically) solutions to optimal transport problems. We study the existence of solutions for this problem and demonstrate that they only relate to optimal transport under assumptions that are significantly stronger than those previously acknowledged. In particular, we present several counterexamples that invalidate earlier equivalence results in the literature, and we argue that enforcing a gradient constraint on rectified flows is, in general, not a reliable method for computing optimal transport maps.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。