arXiv:2506.23971cs.LG2025-06NeurIPS被引 239

通用原子模型UMA在百亿结构上训练,单模型即可超越专业模型。

UMA: A Family of Universal Models for Atoms

论文配图:UMA: A Family of Universal Models for Atoms
图 1 · 摘自论文原文
  • 采用线性专家混合架构,参数量大但每结构仅激活5000万
  • 1.4B参数模型在未微调下表现媲美甚至超过专用模型
  • 适用于化学、材料、制药等多领域,适合快速仿真需求

快速准确地从原子模拟中计算性质对化学与材料科学的诸多应用至关重要,如药物发现、储能和半导体制造。Meta FAIR提出通用原子模型家族UMA,旨在提升速度、精度与泛化能力。UMA在超5亿个独特3D原子结构(迄今最大训练规模)上训练,涵盖分子、材料和催化剂等多个化学领域。我们建立了经验缩放定律,指导模型容量与数据量协同增长以实现最优精度。UMA小模型和中型模型采用新颖的线性专家混合架构,在不牺牲速度的前提下提升容量。例如,UMA-medium拥有14亿参数,但每原子结构仅激活约5000万参数。我们在跨多个领域的多样化应用中评估了这些模型,发现令人惊讶的是,未经微调的单一模型表现可媲美或优于专门设计的模型。我们已开源UMA代码、权重及配套数据,以加速计算流程并推动社区持续构建更强大的AI模型。

原文摘要 · Abstract (English)

The ability to quickly and accurately compute properties from atomic simulations is critical for advancing a large number of applications in chemistry and materials science including drug discovery, energy storage, and semiconductor manufacturing. To address this need, Meta FAIR presents a family of Universal Models for Atoms (UMA), designed to push the frontier of speed, accuracy, and generalization. UMA models are trained on half a billion unique 3D atomic structures (the largest training runs to date) by compiling data across multiple chemical domains, e.g. molecules, materials, and catalysts. We develop empirical scaling laws to help understand how to increase model capacity alongside dataset size to achieve the best accuracy. The UMA small and medium models utilize a novel architectural design we refer to as mixture of linear experts that enables increasing model capacity without sacrificing speed. For example, UMA-medium has 1.4B parameters but only ~50M active parameters per atomic structure. We evaluate UMA models on a diverse set of applications across multiple domains and find that, remarkably, a single model without any fine-tuning can perform similarly or better than specialized models. We are releasing the UMA code, weights, and associated data to accelerate computational workflows and enable the community to continue to build increasingly capable AI models.

原子模型通用模型深度学习材料科学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。