arXiv:2504.10612cs.LGcs.AI2025-04NeurIPS被引 30

提出能量匹配框架,统一流模型与能量模型,提升生成质量与灵活性。

Energy Matching: Unifying Flow Matching and Energy-Based Models for Generative Modeling

  • 用单一标量场同时实现生成与正则化,无需时间依赖或额外网络。
  • 在CIFAR-10和ImageNet上生成质量显著优于现有能量模型。
  • 支持多模态探索,适用于蛋白质等复杂结构生成任务。

当前最先进的生成模型通过匹配流或梯度来将噪声映射到数据分布,但难以整合部分观测或先验信息。相比之下,能量模型(EBMs)可通过引入标量能量项解决此问题。本文提出能量匹配框架,使流模型具备能量模型的灵活性。远离数据流形时,样本沿无旋、最优传输路径从噪声演化至数据;接近数据流形时,熵能项引导系统进入玻尔兹曼平衡分布,显式捕捉数据的潜在似然结构。我们以单个时间无关的标量场参数化该动力学,既作为强大生成器,又作为灵活先验用于逆问题正则化。该方法在CIFAR-10和ImageNet生成任务中显著优于现有EBM,同时保持远离数据流形时的无模拟训练优势。此外,利用方法灵活性引入交互能项,支持多样模式探索,在可控蛋白质生成场景中验证有效。该方法无需时间条件、辅助生成器或额外网络,学习标量势能,是近期EBM方法的重要突破。我们认为这一简化而严谨的范式显著提升了EBM能力,推动其在多元领域生成建模中的广泛应用。

原文摘要 · Abstract (English)

Current state-of-the-art generative models map noise to data distributions by matching flows or scores. A key limitation of these models is their inability to readily integrate available partial observations and additional priors. In contrast, energy-based models (EBMs) address this by incorporating corresponding scalar energy terms. Here, we propose Energy Matching, a framework that endows flow-based approaches with the flexibility of EBMs. Far from the data manifold, samples move from noise to data along irrotational, optimal transport paths. As they approach the data manifold, an entropic energy term guides the system into a Boltzmann equilibrium distribution, explicitly capturing the underlying likelihood structure of the data. We parameterize these dynamics with a single time-independent scalar field, which serves as both a powerful generator and a flexible prior for effective regularization of inverse problems. The present method substantially outperforms existing EBMs on CIFAR-10 and ImageNet generation in terms of fidelity, while retaining simulation-free training of transport-based approaches away from the data manifold. Furthermore, we leverage the flexibility of the method to introduce an interaction energy that supports the exploration of diverse modes, which we demonstrate in a controlled protein generation setting. This approach learns a scalar potential energy, without time conditioning, auxiliary generators, or additional networks, marking a significant departure from recent EBM methods. We believe this simplified yet rigorous formulation significantly advances EBMs capabilities and paves the way for their wider adoption in generative modeling in diverse domains.

生成模型能量模型流模型标量场

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。