arXiv:2605.05530cs.LG2026-05

用李雅普诺夫函数统一生成模型训练与采样,实现无需时间条件的高效采样。

Energy Generative Modeling: A Lyapunov-based Energy Matching Perspective

论文配图:Energy Generative Modeling: A Lyapunov-based Energy Matching Perspective
图 1 · 摘自论文原文
  • 将生成过程建模为基于KL散度的非线性控制问题,训练与采样同属一个动态框架。
  • 提出有限步停止准则,证明确定性梯度流无李雅普诺夫证书。
  • 支持能量叠加后保持吉布斯不变测度,适用于受限生成与加速采样。

基于静态标量能量函数的生成模型是一种新兴范式,其通过梯度场驱动样本生成,完全无需时间条件。本文将训练与采样统一于同一框架:在Wasserstein空间上的密度传输,视为以Kullback-Leibler (KL) 散度为李雅普诺夫函数的非线性控制问题。训练与采样仅为初始条件不同的同一主动力学实例。在此自治框架下,我们得到两个解析结果:首先,由于李雅普诺夫证书为渐近性质,我们推导出朗之万采样的有限步停止准则,并证明同一能量景观上确定性梯度流不存在李雅普诺夫证书;其次,该重构使非线性控制理论工具可应用于静态标量能量生成模型,即证明训练后的标量能量叠加仍保持显式吉布斯不变测度,并继承闭环李雅普诺夫证书。此外,该框架为受限生成引入障碍函数、加速采样提供收缩度量提供了可能。在合成分布上的实验验证了理论预测。

原文摘要 · Abstract (English)

Generative models based on static scalar energy functions represent an emerging paradigm in which a single time independent potential drives sample generation through its gradient field, eliminating the need for time conditioning entirely. We unify the training and sampling phases of this paradigm, conventionally treated as separate procedures, within a single framework: density transport on the Wasserstein space, cast as a nonlinear control problem in which the Kullback Leibler (KL) divergence serves as a Lyapunov function. Training and sampling are then two instances of this same master dynamics, differing only in initial condition. Within this autonomous framework we develop two analytic results. First, since the Lyapunov certificate is asymptotic, we derive a finite step stopping criterion for Langevin sampling and prove that no Lyapunov certificate exists for the deterministic gradient flow on the same energy landscape. Second, the reformulation brings the toolkit of nonlinear control theory to bear on static scalar energy generative modeling, that is, we show that additive composition of trained scalar energies retains an explicit Gibbs invariant measure and inherits the closed-loop Lyapunov certificate. Beyond these immediate results, this reformulation bridges static scalar energy generative models with the full toolkit of nonlinear control theory, opening the door to barrier functions for constrained generation and contraction metrics for accelerated sampling. Experiments on synthetic distributions validate the theoretical predictions.

生成模型李雅普诺夫能量匹配采样优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。