arXiv:2412.00401cs.LGcond-mat.mtrl-sci2024-12被引 4

PAL让机器学习势能模型训练更高效,自动并行处理数据采集。

PAL -- Parallel active learning for machine-learned potentials

  • 基于MPI实现异步并行,自动管理数据采集与模型训练流程。
  • 在多种分子和流体系统上实现显著加速,提升计算资源利用率。
  • 适合需要大规模模拟的科研人员,尤其擅长高性能量子化学计算。

构建代表目标域的数据集对训练有效机器学习模型至关重要。主动学习(AL)是一种迭代扩展训练数据以提升模型性能同时降低数据获取成本的有前景方法。然而,当前的AL工作流通常需要人工干预且缺乏并行性,导致效率低下,未能充分利用现代计算资源。本文提出PAL——一个自动化、模块化、支持并行的主动学习库,通过消息传递接口(MPI)在共享内存和分布式内存系统上集成并管理AL任务的执行与通信。PAL允许用户灵活设计和定制主动学习场景的各个组件,包括带有不确定性估计的机器学习模型、真实标签的标注器(oracle),以及探索目标空间的策略。我们证明PAL显著降低了计算开销,提升了可扩展性,在CPU和GPU硬件上通过异步并行实现了显著加速。将PAL应用于多个真实场景——包括生物分子体系的基态反应、分子激发态动力学、无机簇模拟及热流体动力学——展示了其在加速机器学习模型开发方面的有效性。结果表明,PAL能够高效利用高性能计算资源,推动科学与工程研究的进步。

原文摘要 · Abstract (English)

Constructing datasets representative of the target domain is essential for training effective machine learning models. Active learning (AL) is a promising method that iteratively extends training data to enhance model performance while minimizing data acquisition costs. However, current AL workflows often require human intervention and lack parallelism, leading to inefficiencies and underutilization of modern computational resources. In this work, we introduce PAL, an automated, modular, and parallel active learning library that integrates AL tasks and manages their execution and communication on shared- and distributed-memory systems using the Message Passing Interface (MPI). PAL provides users with the flexibility to design and customize all components of their active learning scenarios, including machine learning models with uncertainty estimation, oracles for ground truth labeling, and strategies for exploring the target space. We demonstrate that PAL significantly reduces computational overhead and improves scalability, achieving substantial speed-ups through asynchronous parallelization on CPU and GPU hardware. Applications of PAL to several real-world scenarios - including ground-state reactions in biomolecular systems, excited-state dynamics of molecules, simulations of inorganic clusters, and thermo-fluid dynamics - illustrate its effectiveness in accelerating the development of machine learning models. Our results show that PAL enables efficient utilization of high-performance computing resources in active learning workflows, fostering advancements in scientific research and engineering applications.

主动学习机器学习势高性能计算并行

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。