用迭代预训练提升原子间势能模型精度与效率
Iterative Pretraining Framework for Interatomic Potentials
- 通过迭代预训练+遗忘机制,逐步优化势能模型
- 在Mo-S-O系统中误差降低80%,速度提升4倍
- 轻量架构适合特定体系,比通用力场更准更快
机器学习原子间势能(MLIPs)可在保持从头算精度的同时高效进行分子动力学模拟,已广泛应用于物理科学领域。然而,其性能通常依赖大规模标注数据。现有预训练策略常因预训练目标与下游任务不匹配,或需大量标注数据和复杂架构才能实现良好泛化。为此,我们提出用于原子间势能的迭代预训练框架(IPIP),通过迭代优化提升模型预测性能,并引入遗忘机制防止陷入局部最优。相较于通用基础模型因通用性与体系特异性之间的权衡导致性能下降,IPIP采用轻量级架构,在特定体系上实现了更高精度与效率。相比通用力场,该方法在挑战性较强的Mo-S-O系统中预测误差降低超过80%,计算速度提升最多4倍,支持快速且精确的模拟。
原文摘要 · Abstract (English)
Machine learning interatomic potentials (MLIPs) enable efficient molecular dynamics (MD) simulations with ab initio accuracy and have been applied across various domains in physical science. However, their performance often relies on large-scale labeled training data. While existing pretraining strategies can improve model performance, they often suffer from a mismatch between the objectives of pretraining and downstream tasks or rely on extensive labeled datasets and increasingly complex architectures to achieve broad generalization. To address these challenges, we propose Iterative Pretraining for Interatomic Potentials (IPIP), a framework designed to iteratively improve the predictive performance of MLIP models. IPIP incorporates a forgetting mechanism to prevent iterative training from converging to suboptimal local minima. Unlike general-purpose foundation models, which frequently underperform on specialized tasks due to a trade-off between generality and system-specific accuracy, IPIP achieves higher accuracy and efficiency using lightweight architectures. Compared to general-purpose force fields, this approach achieves over 80% reduction in prediction error and up to 4x speedup in the challenging Mo-S-O system, enabling fast and accurate simulations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。