提出抗噪强化学习框架,让模拟伊辛机在噪声下仍高效求解优化问题。
Boltzmann Reinforcement Learning for Noise resilience in Analog Ising Machines
- 用变分强化学习逼近玻尔兹曼分布,通过多测量融合提升抗噪能力。
- 在3%高斯噪声下保持98%最优解保真度,远超传统MCMC的51%。
- 适合需要高速、抗噪的模拟计算场景,如大规模优化与物态分析。
模拟伊辛机(AIMs)作为一种有前景的组合优化范式,利用物理动力学实现高能效的伊辛问题求解。然而,传统优化与采样算法在这些平台上常受固有测量噪声限制。本文提出BRAIN(Boltzmann Reinforcement for Analog Ising Networks),一种基于变分强化学习的分布学习框架,用于近似玻尔兹曼分布。通过从逐状态采样转向聚合多个噪声测量信息,BRAIN对模拟伊辛机典型的高斯噪声具有鲁棒性。我们在多种组合拓扑上评估BRAIN,包括居里-外斯和二维最近邻伊辛系统。在真实3%高斯测量噪声下,BRAIN保持98%的基态保真度,而马尔可夫链蒙特卡洛(MCMC)方法降至51%保真度。此外,BRAIN在该条件下达到与MCMC相当的解速率达192倍。BRAIN在65,536自旋规模下呈现$/mathcal{O}(N^{1.55})$扩展性,并在高达40%的严重测量不确定性下保持稳健。除基态优化外,BRAIN还能准确捕捉热力学相变与亚稳态,为复杂优化中使用模拟计算架构提供可扩展且抗噪的方法。
原文摘要 · Abstract (English)
Analog Ising machines (AIMs) have emerged as a promising paradigm for combinatorial optimization, utilizing physical dynamics to solve Ising problems with high energy efficiency. However, the performance of traditional optimization and sampling algorithms on these platforms is often limited by inherent measurement noise. We introduce BRAIN (Boltzmann Reinforcement for Analog Ising Networks), a distribution learning framework that utilizes variational reinforcement learning to approximate the Boltzmann distribution. By shifting from state-by-state sampling to aggregating information across multiple noisy measurements, BRAIN is resilient to Gaussian noise characteristic of AIMs. We evaluate BRAIN across diverse combinatorial topologies, including the Curie-Weiss and 2D nearest-neighbor Ising systems. We find that under realistic 3\% Gaussian measurement noise, BRAIN maintains 98\% ground state fidelity, whereas Markov Chain Monte Carlo (MCMC) methods degrade to 51\% fidelity. Furthermore, BRAIN reaches the MCMC-equivalent solution up to 192x faster under these conditions. BRAIN exhibits $\mathcal{O}(N^{1.55})$ scaling up to 65,536 spins and maintains robustness against severe measurement uncertainty up to 40\%. Beyond ground state optimization, BRAIN accurately captures thermodynamic phase transitions and metastable states, providing a scalable and noise-resilient method for utilizing analog computing architectures in complex optimizations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。