用位移插值提升神经最优传输的稳定性与精度
Improving Neural Optimal Transport via Displacement Interpolation
- 通过位移插值构建连续运输轨迹,替代传统极小极大优化
- 在图像翻译任务中优于现有最优传输模型,训练更稳定
- 适合需要精确分布对齐的生成模型与跨域翻译场景
最优传输(OT)理论研究将源分布以最小代价转移至目标分布的运输映射。近年来,基于神经网络学习给定代价函数下的最优传输映射的方法陆续出现,统称为OT Map。该方法在生成建模、无配对图像翻译等任务中表现优异。然而,现有方法常采用极小极大优化,易出现训练不稳定和对超参数敏感的问题。本文提出一种新方法——位移插值最优传输模型(DIOTM),通过利用位移插值特性提升稳定性并更好逼近最优传输映射。我们推导了特定时间点t下位移插值的对偶形式,并证明了不同时刻对偶问题之间的关联性。这一结果使我们能够利用位移插值的完整轨迹来学习运输映射。实验表明,DIOTM在图像到图像翻译任务中显著优于现有基于OT的模型,且训练更加稳定。
原文摘要 · Abstract (English)
Optimal Transport (OT) theory investigates the cost-minimizing transport map that moves a source distribution to a target distribution. Recently, several approaches have emerged for learning the optimal transport map for a given cost function using neural networks. We refer to these approaches as the OT Map. OT Map provides a powerful tool for diverse machine learning tasks, such as generative modeling and unpaired image-to-image translation. However, existing methods that utilize max-min optimization often experience training instability and sensitivity to hyperparameters. In this paper, we propose a novel method to improve stability and achieve a better approximation of the OT Map by exploiting displacement interpolation, dubbed Displacement Interpolation Optimal Transport Model (DIOTM). We derive the dual formulation of displacement interpolation at specific time $t$ and prove how these dual problems are related across time. This result allows us to utilize the entire trajectory of displacement interpolation in learning the OT Map. Our method improves the training stability and achieves superior results in estimating optimal transport maps. We demonstrate that DIOTM outperforms existing OT-based models on image-to-image translation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。