arXiv:2412.20279stat.MLcs.LG2024-12

用深度学习重构量子最优传输模型,实现连续空间生成与博弈求解。

Deep Generalized Schrödinger Bridges: From Image Generation to Solving Mean-Field Games

  • 将广义薛定谔桥重构成概率模型,借助非线性费曼-卡茨引理导出算法机制
  • 在连续状态空间中满足分布约束,无需离散化或松弛约束条件
  • 适用于生成建模与平均场博弈,打通数学建模与机器学习的桥梁

广义薛定谔桥(GSB)是基于最小作用量原理分析粒子演化路径的基本数学框架,涵盖动能与势能。尽管其在量子力学与最优传输理论中已有深厚基础,本文从算法视角出发,旨在提升其实用性。我们观察到,具有GSB最优结构的运输问题广泛存在于机器学习生成建模、随机控制中的平均场博弈等领域。探索GSB数学建模与现代算法表征之间的内在联系,是一条关键但尚未开发的路径。本文将GSB重新诠释为概率模型,并利用非线性费曼-卡茨引理,自然导出似然度、变分间隙和时序差分等丰富算法概念。由此构建的计算框架基于深度学习与神经网络,运行于完全连续的状态空间(即无网格),并严格满足分布约束,区别于以往依赖空间离散化或约束松弛的数值求解方法。我们在生成建模与平均场博弈中验证了该方法的有效性,凸显其在数学建模、随机过程、控制与机器学习交叉领域的变革性应用潜力。

原文摘要 · Abstract (English)

Generalized Schrödinger Bridges (GSBs) are a fundamental mathematical framework used to analyze the most likely particle evolution based on the principle of least action including kinetic and potential energy. In parallel to their well-established presence in the theoretical realms of quantum mechanics and optimal transport, this paper focuses on an algorithmic perspective, aiming to enhance practical usage. Our motivated observation is that transportation problems with the optimality structures delineated by GSBs are pervasive across various scientific domains, such as generative modeling in machine learning, mean-field games in stochastic control, and more. Exploring the intrinsic connection between the mathematical modeling of GSBs and the modern algorithmic characterization therefore presents a crucial, yet untapped, avenue. In this paper, we reinterpret GSBs as probabilistic models and demonstrate that, with a delicate mathematical tool known as the nonlinear Feynman-Kac lemma, rich algorithmic concepts, such as likelihoods, variational gaps, and temporal differences, emerge naturally from the optimality structures of GSBs. The resulting computational framework, driven by deep learning and neural networks, operates in a fully continuous state space (i.e., mesh-free) and satisfies distribution constraints, setting it apart from prior numerical solvers relying on spatial discretization or constraint relaxation. We demonstrate the efficacy of our method in generative modeling and mean-field games, highlighting its transformative applications at the intersection of mathematical modeling, stochastic process, control, and machine learning.

生成模型最优传输平均场博弈深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。