arXiv:2510.11829cs.LGmath.DS2025-10被引 3

提出软约束薛定谔桥模型,提升生成AI在低数据场景下的稳定性。

Schrödinger bridge for generative AI: Soft-constrained formulation and convergence analysis

  • 用惩罚函数替代硬约束,构建更灵活的随机控制框架。
  • 证明惩罚项增大时,控制与价值函数以线性速率收敛到经典解。
  • 为生成建模、微调和迁移学习提供理论支持,适合算法研究者。

生成式AI可视为将简单参考分布映射到复杂数据分布的建模问题,近年与经典的薛定谔桥问题(SBP)建立了强关联,因其均通过熵正则化随机动力学插值指定边缘分布。然而,经典SBP施加硬终端约束,在高维或数据稀缺场景中常导致不稳定。为此,本文采用软约束薛定谔桥问题(SCSBP),将终端约束替换为一般惩罚函数,从而导出麦凯恩-弗拉斯洛夫型的更灵活随机控制公式。我们证明了所有惩罚水平下最优解的存在性,并证明当惩罚增加时,控制与价值函数以线性速率收敛至经典SBP解。分析基于杜布的h-变换表示、薛定谔势的稳定性结果、Gamma-收敛及一种新颖的不动点论证,该论证将测度空间上的优化问题与辅助熵正则运输问题耦合。这些结果首次提供了软约束桥的定量收敛保证,揭示了惩罚正则化如何实现鲁棒生成建模、微调与迁移学习。

原文摘要 · Abstract (English)

Generative AI can be framed as the problem of learning a model that maps simple reference measures into complex data distributions, and it has recently found a strong connection to the classical theory of the Schrödinger bridge problems (SBPs) due partly to their common nature of interpolating between prescribed marginals via entropy-regularized stochastic dynamics. However, the classical SBP enforces hard terminal constraints, which often leads to instability in practical implementations, especially in high-dimensional or data-scarce regimes. To address this challenge, we follow the idea of the so-called soft-constrained Schrödinger bridge problem (SCSBP), in which the terminal constraint is replaced by a general penalty function. This relaxation leads to a more flexible stochastic control formulation of McKean-Vlasov type. We establish the existence of optimal solutions for all penalty levels and prove that, as the penalty grows, both the controls and value functions converge to those of the classical SBP at a linear rate. Our analysis builds on Doob's h-transform representations, the stability results of Schrödinger potentials, Gamma-convergence, and a novel fixed-point argument that couples an optimization problem over the space of measures with an auxiliary entropic optimal transport problem. These results not only provide the first quantitative convergence guarantees for soft-constrained bridges but also shed light on how penalty regularization enables robust generative modeling, fine-tuning, and transfer learning.

生成模型随机控制薛定谔桥理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。