用价值驱动的路径生成数据,速度快且稳定。
Generative Modeling by Value-Driven Transport

- 基于控制理论构建线性规划模型,直接求解最优价值函数
- 生成路径笔直,模拟快且鲁棒,支持条件生成等扩展功能
- 适合需要高效生成与灵活控制的场景,如图像合成与跨域转换
我们提出一种基于离散时间随机控制的测度传输新框架。借鉴控制理论经典结果,将问题建模为线性规划,其对偶变量对应控制问题的最优价值函数,直接编码最优控制策略。利用该线性规划形式,我们开发了一种无需模拟的高效原-对偶算法,用于近似计算最优价值函数及相应的价值驱动传输(VDT)策略,逼近真实最优策略。实验表明,训练良好的VDT策略相比基于流、扩散或Schrödinger桥的先进方法具有诸多优势:传输路径更直,可快速稳健地模拟,且能像扩散和流模型一样轻松集成条件生成、无分类器引导、无配对数据到数据转换等功能。在多种实验中表现优异,展现出良好的可扩展潜力。
原文摘要 · Abstract (English)
We propose a new framework for generative modeling based on a discrete-time stochastic control formulation of measure transport. Adapting classic results from control theory, we formulate our problem as a linear program whose dual variables correspond to the \emph{optimal value function} of the control problem, which directly encodes the optimal control policy. Exploiting this LP formulation, we develop an efficient simulation-free primal-dual algorithm for computing approximately optimal value functions and the associated \emph{value-driven transport} (VDT) policies which approximate the true optimal policy. We show that well-trained VDT policies enjoy numerous favorable properties in comparison with other state-of-the-art methods based on flows, diffusions, or Schrödinger bridges: they lead to straight transport paths which can be simulated quickly and robustly, and can be enhanced in all the same ways as diffusion and flow-based models (e.g., conditional generation, classifier-free guidance, unpaired data-to-data translation are all easy to incorporate). We evaluate our methodology in a range of experiments, with results that indicate strong performance and good potential for scalability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。