提出新算法实现无需反复训练模型的跨域数据转换。
Schrödinger Bridge Flow for Unpaired Data Translation
- 基于路径测度流思想,直接求解熵正则化最优传输
- 在多种无配对数据转换任务上表现优于现有方法
- 适合需要高效跨模态转换的研究者
机器学习中的质量传输问题旨在计算将一个分布映射到另一个分布的变换。生成模型如生成对抗网络(GAN)和去噪扩散模型(DDM)已被用于解决此类问题,催生了CycleGAN和桥匹配等方法。然而,这些方法无法逼近最优传输(OT)映射,而后者具有理想性质。现有高维数据中近似OT映射的技术,如基于DDM的修正流和薛定谔桥方法,需在每次迭代中完整训练一个类似DDM的模型,或使用小批量技术引入显著误差。本文提出一种新算法,用于计算薛定谔桥——一种动态熵正则化的最优传输形式,避免了多次训练类似DDM的模型。该算法对应于路径测度流的离散化,称为薛定谔桥流,其唯一稳定点即为薛定谔桥。我们在多种无配对数据转换任务上验证了该算法的性能。
原文摘要 · Abstract (English)
Mass transport problems arise in many areas of machine learning whereby one wants to compute a map transporting one distribution to another. Generative modeling techniques like Generative Adversarial Networks (GANs) and Denoising Diffusion Models (DDMs) have been successfully adapted to solve such transport problems, resulting in CycleGAN and Bridge Matching respectively. However, these methods do not approximate Optimal Transport (OT) maps, which are known to have desirable properties. Existing techniques approximating OT maps for high-dimensional data-rich problems, such as DDM-based Rectified Flow and Schrödinger Bridge procedures, require fully training a DDM-type model at each iteration, or use mini-batch techniques which can introduce significant errors. We propose a novel algorithm to compute the Schrödinger Bridge, a dynamic entropy-regularised version of OT, that eliminates the need to train multiple DDM-like models. This algorithm corresponds to a discretisation of a flow of path measures, which we call the Schrödinger Bridge Flow, whose only stationary point is the Schrödinger Bridge. We demonstrate the performance of our algorithm on a variety of unpaired data translation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。