arXiv:2504.14425stat.MLcs.LG2025-04被引 12

优化动态运输路径,让生成模型更准更快。

Optimal Scheduling of Dynamic Transport

  • 用可变时间调度替代匀速路径,提升传输效率。
  • 最优调度使速度场的利普希茨常数指数级降低。
  • 理论可解,适合需要高精度生成的任务。

基于流的采样与生成模型利用连续时间动力系统表示将源分布推向目标分布的传输映射。时间轴引入了大量设计自由度,核心问题是如何利用这一自由度。尽管许多方法采用直线(即零加速度)轨迹,本文表明特定的“弯曲”轨迹可显著提升近似与学习效果。具体而言,我们考虑任意给定传输映射 $T$ 在单位时间内的插值,并寻找时间调度 $τ: [0,1] o [0,1]$,以最小化所有 $t \ in [0,1]$ 下对应速度场的空间利普希茨常数。该量至关重要,因它控制了从数据中学习速度场时的近似误差。我们证明,对于一大类源/目标分布和传输映射 $T$,最优调度可闭式求解,且所得最优利普希茨常数比恒等调度(如沃尔沙伊特测地线)诱导的结果呈指数级更小。证明方法基于变分法与 $Γ$-收敛,通过一族光滑可处理的问题逼近前述退化目标。

原文摘要 · Abstract (English)

Flow-based methods for sampling and generative modeling use continuous-time dynamical systems to represent a {transport map} that pushes forward a source measure to a target measure. The introduction of a time axis provides considerable design freedom, and a central question is how to exploit this freedom. Though many popular methods seek straight line (i.e., zero acceleration) trajectories, we show here that a specific class of ``curved'' trajectories can significantly improve approximation and learning. In particular, we consider the unit-time interpolation of any given transport map $T$ and seek the schedule $τ: [0,1] \to [0,1]$ that minimizes the spatial Lipschitz constant of the corresponding velocity field over all times $t \in [0,1]$. This quantity is crucial as it allows for control of the approximation error when the velocity field is learned from data. We show that, for a broad class of source/target measures and transport maps $T$, the \emph{optimal schedule} can be computed in closed form, and that the resulting optimal Lipschitz constant is \emph{exponentially smaller} than that induced by an identity schedule (corresponding to, for instance, the Wasserstein geodesic). Our proof technique relies on the calculus of variations and $Γ$-convergence, allowing us to approximate the aforementioned degenerate objective by a family of smooth, tractable problems.

生成模型动态系统优化调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。