arXiv:2509.26364cs.LG2025-09被引 4

无需数据样本,直接从密度函数构建随机动力系统。

Data-to-Energy Stochastic Dynamics

  • 基于强化学习思想扩展迭代比例调整法,实现无样本条件下的动态建模。
  • 成功在多峰分布间学习传输路径,且可提升现有算法的扩散系数学习能力。
  • 适用于生成模型后验采样,实现无需配对数据的图像转换。

Schrödinger桥问题旨在寻找一个随机动力系统,在最小化某种运输代价的前提下连接两个边缘分布。该问题作为最优传输在随机情形下的推广,近年来因与扩散模型、流匹配的关联及其在自然科学中的应用而受到关注。然而,现有算法仅能在两个分布均有样本时使用。本文提出首个通用方法,可在仅知分布未归一化密度(无样本)的情况下建模Schrödinger桥。算法基于对迭代比例调整(IPF)过程的数据无关扩展,受近期离线策略强化学习在扩散采样器训练中的进展启发。我们在合成问题上验证了所提“数据到能量”IPF的有效性,发现其能成功学习多峰分布间的传输。作为副产物,由于假设固定时间离散化,我们发现通过学习动力系统的扩散系数,可显著改进现有数据到数据的桥算法。最后,我们将新算法应用于生成模型潜在空间的后验采样,实现了无需配对数据的图像到图像转换。代码见:https://github.com/mmacosha/d2e-stochastic-dynamics

原文摘要 · Abstract (English)

The Schrödinger bridge problem is concerned with finding a stochastic dynamical system bridging two marginal distributions that minimises a certain transportation cost. This problem, which represents a generalisation of optimal transport to the stochastic case, has received attention due to its connections to diffusion models and flow matching, as well as its applications in the natural sciences. However, all existing algorithms allow to infer such dynamics only for cases where samples from both distributions are available. In this paper, we propose the first general method for modelling Schrödinger bridges when one (or both) distributions are given by their unnormalised densities, with no access to data samples. Our algorithm relies on a generalisation of the iterative proportional fitting (IPF) procedure to the data-free case, inspired by recent developments in off-policy reinforcement learning for training of diffusion samplers. We demonstrate the efficacy of the proposed data-to-energy IPF on synthetic problems, finding that it can successfully learn transports between multimodal distributions. As a secondary consequence of our reinforcement learning formulation, which assumes a fixed time discretisation scheme for the dynamics, we find that existing data-to-data Schrödinger bridge algorithms can be substantially improved by learning the diffusion coefficient of the dynamics. Finally, we apply the newly developed algorithm to the problem of sampling posterior distributions in latent spaces of generative models, thus creating a data-free image-to-image translation method. Code: https://github.com/mmacosha/d2e-stochastic-dynamics

随机动力学扩散模型无样本学习生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。