arXiv:2512.02323cs.LGquant-ph2025-12

提出可并行采样的新方法,让能量模型训练更快更准。

Unlocking the Power of Boltzmann Machines by Parallelizable Sampler and Efficient Temperature Estimation

  • 用类量子优化思路设计可并行的采样器,提升效率。
  • 结合温度估计技术,实现比RBMs更强的建模能力。
  • 适合想突破传统限制的能量模型研究者使用。

Boltzmann机器(BMs)是强大的基于能量的生成模型,但其高昂的训练成本使其实际应用多局限于受限玻尔兹曼机(RBMs),后者依赖对比散度高效学习。更精确的学习通常需要马尔可夫链蒙特卡洛(MCMC)采样,但因难以并行化而耗时。为此,我们提出一种受模拟分叉(SB)启发的新采样器——朗之万模拟分叉(LSB),可在保持与MCMC相当精度的同时实现并行采样,且适用于具有通用耦合的任意BMs。然而,LSB无法控制输出分布的逆温度,影响学习效果。为此,我们进一步提出条件期望匹配(CEM)方法,用于高效估计学习过程中的逆温度。结合LSB与CEM,我们构建了称为自适应采样学习(SAL)的高效框架,使表达能力超越RBMs的BMs得以实用化,为能量基生成建模开辟新路径。

原文摘要 · Abstract (English)

Boltzmann machines (BMs) are powerful energy-based generative models, but their heavy training cost has largely confined practical use to Restricted BMs (RBMs) trained with an efficient learning method called contrastive divergence. More accurate learning typically requires Markov chain Monte Carlo (MCMC) Boltzmann sampling, but it is time-consuming due to the difficulty of parallelization for more expressive models. To address this limitation, we first propose a new Boltzmann sampler inspired by a quantum-inspired combinatorial optimization called simulated bifurcation (SB). This SB-inspired approach, which we name Langevin SB (LSB), enables parallelized sampling while maintaining accuracy comparable to MCMC. Furthermore, this is applicable not only to RBMs but also to BMs with general couplings. However, LSB cannot control the inverse temperature of the output Boltzmann distribution, which hinders learning and degrades performance. To overcome this limitation, we also developed an efficient method for estimating the inverse temperature during the learning process, which we call conditional expectation matching (CEM). By combining LSB and CEM, we establish an efficient learning framework for BMs with greater expressive power than RBMs. We refer to this framework as sampler-adaptive learning (SAL). SAL opens new avenues for energy-based generative modeling beyond RBMs.

能量模型采样加速并行计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。