arXiv:2505.22049cs.LG2025-05NeurIPS被引 10

提出可微分的广义切片沃瑟斯坦方法,高效计算高维数据传输路径。

Differentiable Generalized Sliced Wasserstein Plans

  • 将切片最优传输建模为双层优化问题,实现可微分求解
  • 在高维空间中仅需少量切片即可逼近完整传输计划
  • 适用于流形与图像生成等需要快速传输计算的场景

最优传输(OT)在机器学习中备受关注,不仅因其能定义概率分布间的有意义距离(如沃瑟斯坦距离),还因其对传输计划的刻画。然而其计算复杂度仍是瓶颈,切片技术被用于提升规模适应性。最近提出的 min-SWGG 方法通过一维传输计划反推高维空间,选择最低沃瑟斯坦距离的切片作为全维传输计划的近似。尽管该方法具备计算与理论优势,仍存在两个局限:(i) 所需切片数量随数据维度呈指数增长;(ii) 仅限于线性投影。本文将 min-SWGG 重构成双层优化问题,并提出一种可微分近似方案,可在高维设置下高效识别最优切片。进一步定义其广义形式以处理流形上的数据。实验表明该方法在流形梯度流、高维空间及基于切片OT的条件流匹配图像生成等任务中具有实际价值,其中快速计算传输计划至关重要。

原文摘要 · Abstract (English)

Optimal Transport (OT) has attracted significant interest in the machine learning community, not only for its ability to define meaningful distances between probability distributions -- such as the Wasserstein distance -- but also for its formulation of OT plans. Its computational complexity remains a bottleneck, though, and slicing techniques have been developed to scale OT to large datasets. Recently, a novel slicing scheme, dubbed min-SWGG, lifts a single one-dimensional plan back to the original multidimensional space, finally selecting the slice that yields the lowest Wasserstein distance as an approximation of the full OT plan. Despite its computational and theoretical advantages, min-SWGG inherits typical limitations of slicing methods: (i) the number of required slices grows exponentially with the data dimension, and (ii) it is constrained to linear projections. Here, we reformulate min-SWGG as a bilevel optimization problem and propose a differentiable approximation scheme to efficiently identify the optimal slice, even in high-dimensional settings. We furthermore define its generalized extension for accommodating to data living on manifolds. Finally, we demonstrate the practical value of our approach in various applications, including gradient flows on manifolds and high-dimensional spaces, as well as a novel sliced OT-based conditional flow matching for image generation -- where fast computation of transport plans is essential.

最优传输可微分切片方法图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。