arXiv:2504.16262cs.LG2025-04中稿 · Transactions on Ma…被引 3

提出新方法无需采样即可训练能量模型,生成效果好且稳定。

Learning Energy-Based Generative Models via Potential Flow: A Variational Principle Approach to Probability Density Homotopy Matching

  • 用变分原理构建能量驱动的流,直接匹配数据分布
  • 在图像生成等任务上达到现有方法水平,无需辅助网络
  • 适合需要可解释性与高效生成的生成建模场景

能量模型(EBM)因其灵活性和可解释性成为强大的概率生成模型。然而,势流与显式能量模型之间的关系尚未充分探索,而基于隐式马尔可夫链蒙特卡洛(MCMC)采样的对比损失训练在高维情形下常不稳定且计算开销大。本文提出变分势流贝叶斯(VPFB),一种无需隐式MCMC采样、不依赖辅助网络或协同训练的能量生成框架。通过构造由流驱动的密度同伦,并最小化流驱动同伦与边际同伦间的KL散度,实现对数据分布的变分匹配。该原理性设计使得生成建模更鲁棒高效,同时保留了EBM的可解释性。在图像生成、插值、分布外检测及组合生成等任务上的实验表明,本方法在样本质量与任务多样性方面表现优异,性能可媲美现有主流方法。

原文摘要 · Abstract (English)

Energy-based models (EBMs) are a powerful class of probabilistic generative models due to their flexibility and interpretability. However, relationships between potential flows and explicit EBMs remain underexplored, while contrastive divergence training via implicit Markov chain Monte Carlo (MCMC) sampling is often unstable and expensive in high-dimensional settings. In this paper, we propose Variational Potential Flow Bayes (VPFB), a new energy-based generative framework that eliminates the need for implicit MCMC sampling and does not rely on auxiliary networks or cooperative training. VPFB learns an energy-parameterized potential flow by constructing a flow-driven density homotopy that is matched to the data distribution through a variational loss minimizing the Kullback-Leibler divergence between the flow-driven and marginal homotopies. This principled formulation enables robust and efficient generative modeling while preserving the interpretability of EBMs. Experimental results on image generation, interpolation, out-of-distribution detection, and compositional generation confirm the effectiveness of VPFB, showing that our method performs competitively with existing approaches in terms of sample quality and versatility across diverse generative modeling tasks.

生成模型能量模型变分推断流模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。