arXiv:2603.27996cs.LGcs.ET2026-03

用马尔可夫链替代独立噪声,让生成模型更高效地捕捉系统关联性。

From Independent to Correlated Diffusion: Generalized Generative Modeling with Probabilistic Computers

  • 用MCMC动态替代独立噪声,引入物理系统的空间关联结构
  • 在二维伊辛模型和三维自旋玻璃上,相关扩散样本更接近真实分布
  • 适配概率计算机,实现比GPU快数十倍的采样效率

扩散模型作为深度学习中强大的生成框架,将生成建模分解为神经网络确定性计算与随机采样两个基本步骤。当前实现多将大部分计算置于神经网络中,但扩散框架允许对随机转移核进行更广泛选择。本文通过将独立噪声注入替换为包含已知相互作用结构的马尔可夫链蒙特卡洛(MCMC)动力学,广义化了随机采样组件。当耦合强度设为零时,即退化为标准独立扩散。通过显式引入伊辛耦合,去噪与加噪过程利用目标系统代表性的空间相关性。该框架自然映射到基于概率比特(p-bit)的概率计算机(p-computer),相比GPU在采样吞吐量和能效上提升数个数量级。我们在二维铁磁伊辛模型与三维爱德华-安德森自旋玻璃的平衡态上验证该方法,结果表明相关扩散生成的样本比独立扩散更接近MCMC参考分布。更广泛地,该框架表明概率计算机可支持新型扩散算法,利用结构化概率采样实现生成建模。

原文摘要 · Abstract (English)

Diffusion models have emerged as a powerful framework for generative tasks in deep learning. They decompose generative modeling into two computational primitives: deterministic neural-network evaluation and stochastic sampling. Current implementations usually place most computation in the neural network, but diffusion as a framework allows a broader range of choices for the stochastic transition kernel. Here, we generalize the stochastic sampling component by replacing independent noise injection with Markov chain Monte Carlo (MCMC) dynamics that incorporate known interaction structure. Standard independent diffusion is recovered as a special case when couplings are set to zero. By explicitly incorporating Ising couplings into the diffusion dynamics, the noising and denoising processes exploit spatial correlations representative of the target system. The resulting framework maps naturally onto probabilistic computers (p-computers) built from probabilistic bits (p-bits), which provide orders-of-magnitude advantages in sampling throughput and energy efficiency over GPUs. We demonstrate the approach on equilibrium states of the 2D ferromagnetic Ising model and the 3D Edwards-Anderson spin glass, showing that correlated diffusion produces samples in closer agreement with MCMC reference distributions than independent diffusion. More broadly, the framework shows that p-computers can enable new classes of diffusion algorithms that exploit structured probabilistic sampling for generative modeling.

扩散模型概率计算生成建模自旋玻璃

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。