BLIPs 为原子间势能模型提供可信不确定性估计,提升小样本和分布外预测的可靠性。
BLIPs: Bayesian Learned Interatomic Potentials
- 基于变分贝叶斯与自适应变分丢弃,构建可扩展的不确定性建模框架。
- 在数据稀缺或分布外情况下,预测精度优于传统模型且不确定性校准良好。
- 适用于消息传递架构,可无缝微调预训练模型,适合需要可靠置信度的分子模拟场景。
机器学习原子间势能(MLIPs)已成为基于仿真的化学研究的核心工具。然而,如同大多数深度学习模型,MLIPs 在分布外数据或数据稀缺情形下的预测准确性不足,这在仿真化学中极为常见。此外,MLIPs 本身不提供不确定性估计,而这一信息对引导主动学习流程、确保仿真结果与量子计算结果的一致性至关重要。为此,我们提出 BLIPs:贝叶斯学习原子间势能。BLIP 是一种可扩展、架构无关的变分贝叶斯框架,基于自适应变分丢弃,可用于训练或微调 MLIPs。该方法在推理时仅带来极小计算开销,即可输出校准良好的能量与力的不确定性估计,并能与(等变)消息传递架构无缝集成。在基于仿真的计算化学任务中,实证表明,相比标准 MLIPs,BLIPs 在预测精度上有所提升,且在数据稀缺或严重分布外情形下仍能提供可信的不确定性估计。此外,使用 BLIP 微调预训练的 MLIP 模型,可获得一致的性能提升与校准的不确定性。
原文摘要 · Abstract (English)
Machine Learning Interatomic Potentials (MLIPs) are becoming a central tool in simulation-based chemistry. However, like most deep learning models, MLIPs struggle to make accurate predictions on out-of-distribution data or when trained in a data-scarce regime, both common scenarios in simulation-based chemistry. Moreover, MLIPs do not provide uncertainty estimates by construction, which are fundamental to guide active learning pipelines and to ensure the accuracy of simulation results compared to quantum calculations. To address this shortcoming, we propose BLIPs: Bayesian Learned Interatomic Potentials. BLIP is a scalable, architecture-agnostic variational Bayesian framework for training or fine-tuning MLIPs, built on an adaptive version of Variational Dropout. BLIP delivers well-calibrated uncertainty estimates and minimal computational overhead for energy and forces prediction at inference time, while integrating seamlessly with (equivariant) message-passing architectures. Empirical results on simulation-based computational chemistry tasks demonstrate improved predictive accuracy with respect to standard MLIPs, and trustworthy uncertainty estimates, especially in data-scarse or heavy out-of-distribution regimes. Moreover, fine-tuning pretrained MLIPs with BLIP yields consistent performance gains and calibrated uncertainties.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。