用机器学习提升蒙特卡洛采样效率，理论分析最优训练与采样策略。
Performance of machine-learning-assisted Monte Carlo in sampling from simple statistical physics models
- 基于梯度下降优化浅层MADE架构，推导出最优权重配置
- 对比顺序退火中是否加入局部马尔可夫采样，发现后者显著提升采样质量
- 为机器学习辅助蒙特卡洛提供首个完整理论框架，适合算法研究者
近年来，机器学习被广泛用于辅助难以采样的物理系统模拟。尽管已有多种架构和流程提出，但理论理解仍不充分，存在实现不佳的风险。本文针对曲里-韦斯模型，对常用的顺序退火方法结合浅层MADE架构进行了完整的解析研究。工作贡献有二：首先，给出了梯度下降优化下的最优权重描述及训练机制；其次，比较了顺序退火中加入与不加入局部马尔可夫蒙特卡洛步骤的差异。由此可给出该场景下最优方法的理论预测。本工作为机器学习与蒙特卡洛采样融合提供了清晰的理论基础。
原文摘要 · Abstract (English)
Recent years have seen a rise in the application of machine learning techniques to aid the simulation of hard-to-sample systems that cannot be studied using traditional methods. Despite the introduction of many different architectures and procedures, a wide theoretical understanding is still lacking, with the risk of suboptimal implementations. As a first step to address this gap, we provide here a complete analytic study of the widely-used Sequential Tempering procedure applied to a shallow MADE architecture for the Curie-Weiss model. The contribution of this work is twofold: firstly, we give a description of the optimal weights and of the training under Gradient Descent optimization. Secondly, we compare what happens in Sequential Tempering with and without the addition of local Metropolis Monte Carlo steps. We are thus able to give theoretical predictions on the best procedure to apply in this case. This work establishes a clear theoretical basis for the integration of machine learning techniques into Monte Carlo sampling and optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。