优化蒙特卡洛模拟中温度设置,提升采样效率。
Refined Gradient-Based Temperature Optimization for the Replica-Exchange Monte-Carlo Method
- 基于梯度的在线温度调节,严格满足逆温单调性约束。
- 使相邻副本间接受率方差趋近于零,显著降低往返时间。
- 无需调参且避免不稳定性,适合复杂多模态系统模拟。
副本交换蒙特卡洛(RXMC)方法是一种强大的马尔可夫链蒙特卡洛算法,适用于从多模态分布中采样,此类分布对传统方法极具挑战。RXMC的采样效率高度依赖于温度选择,而最优温度的确定仍是难题。本文提出一种改进的在线温度选择方法,扩展了先前的基于梯度的优化框架。在原有方法基础上,引入重参数化技术,严格强制实现逆温度的单调性等物理约束,这些在原框架中未被明确处理。所提方法将相邻副本间接受率的方差定义为损失函数,利用采样过程中的微分信息估计其梯度,并通过梯度下降优化温度。通过在典型自旋系统上的实验验证了该方法的有效性,包括二维铁磁伊辛模型、二维铁磁XY模型和三维爱德华-安德森模型。结果表明,该方法成功实现了均匀接受率,并显著减少了温度空间内的往返时间。此外,相比近期提出的需精细调参的策略梯度方法,本方法具有显著优势,同时避免了导致优化不稳定的约束违反问题。
原文摘要 · Abstract (English)
The replica-exchange Monte-Carlo (RXMC) method is a powerful Markov-chain Monte-Carlo algorithm for sampling from multi-modal distributions, which are challenging for conventional methods. The sampling efficiency of the RXMC method depends highly on the selection of the temperatures, and finding optimal temperatures remains a challenge. In this study, we propose a refined online temperature selection method by extending the gradient-based optimization framework proposed previously. Building upon the existing temperature update approach, we introduce a reparameterization technique to strictly enforce physical constraints, such as the monotonic ordering of inverse temperatures, which were not explicitly addressed in the original formulation. The proposed method defines the variance of acceptance rates between adjacent replicas as a loss function, estimates its gradient using differential information from the sampling process, and optimizes the temperatures via gradient descent. We demonstrate the effectiveness of our method through experiments on benchmark spin systems, including the two-dimensional ferromagnetic Ising model, the two-dimensional ferromagnetic XY model, and the three-dimensional Edwards-Anderson model. Our results show that the method successfully achieves uniform acceptance rates and reduces round-trip times across the temperature space. Furthermore, our proposed method offers a significant advantage over recently proposed policy gradient method that require careful hyperparameter tuning, while simultaneously preventing the constraint violations that destabilize optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。