arXiv:2507.13805cs.LGcond-mat.mtrl-sci2025-07被引 1

用贝叶斯神经网络实现模型在线微调,自动识别罕见事件并提升精度。

On-the-Fly Fine-Tuning of Foundational Neural Network Potentials: A Bayesian Neural Network Approach

  • 基于贝叶斯神经网络评估模型不确定性,支持在线微调。
  • 在保持预设精度前提下,自动识别并优先采样稀有事件。
  • 适合缺乏机器学习背景的科研人员快速构建高精度力场模型。

由于从第一性原理计算原子间作用力的计算复杂度较高,构建机器学习力场已成为研究热点。然而,生成足够大且多样化的训练数据集本身也带来巨大计算负担,使得该方法在稀有事件或配置空间庞大的系统中难以应用。对大规模材料或分子数据库预训练的通用模型进行微调,可显著减少所需训练数据量。但即便如此,构建合适的数据集仍具挑战性,尤其对非专业用户而言。在在线学习中,可通过模拟过程中模型的不确定性判断是否需要重新用经典方法计算并更新模型,从而自动化数据集构建。然而,如何在微调过程中评估通用模型的不确定性成为关键难题,因多数通用模型缺乏不确定性量化能力。本文提出基于贝叶斯神经网络的微调方法与后续在线工作流,可在保证预设精度的同时自动微调模型,并以高于其自然发生率的频率采样过渡态等稀有事件。

原文摘要 · Abstract (English)

Due to the computational complexity of evaluating interatomic forces from first principles, the creation of interatomic machine learning force fields has become a highly active field of research. However, the generation of training datasets of sufficient size and sample diversity itself comes with a computational burden that can make this approach impractical for modeling rare events or systems with a large configuration space. Fine-tuning foundation models that have been pre-trained on large-scale material or molecular databases offers a promising opportunity to reduce the amount of training data necessary to reach a desired level of accuracy. However, even if this approach requires less training data overall, creating a suitable training dataset can still be a very challenging problem, especially for systems with rare events and for end-users who don't have an extensive background in machine learning. In on-the-fly learning, the creation of a training dataset can be largely automated by using model uncertainty during the simulation to decide if the model is accurate enough or if a structure should be recalculated with classical methods and used to update the model. A key challenge for applying this form of active learning to the fine-tuning of foundation models is how to assess the uncertainty of those models during the fine-tuning process, even though most foundation models lack any form of uncertainty quantification. In this paper, we overcome this challenge by introducing a fine-tuning approach based on Bayesian neural network methods and a subsequent on-the-fly workflow that automatically fine-tunes the model while maintaining a pre-specified accuracy and can detect rare events such as transition states and sample them at an increased rate relative to their occurrence.

机器学习力场贝叶斯神经网络在线学习稀有事件

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。