arXiv:2510.00027cs.LGcs.AI2025-10被引 6

用Transformer模型学习原子间势能,无需硬编码对称性约束。

Learning Inter-Atomic Potentials without Explicit Equivariance

  • 用嵌入空间优化让普通Transformer自动满足旋转平移对称性。
  • 在OMol25数据集上性能接近顶尖等变模型,小样本时提升40%~60%。
  • 适合追求高效可扩展的分子模拟研究者,尤其关注模型灵活性者。

精确且可扩展的机器学习原子间势能(MLIPs)对从药物发现到新材料设计的分子模拟至关重要。当前最先进的模型通过等变神经网络架构强制实现旋转平移对称性,这种硬编码归纳偏置常导致灵活性、计算效率和可扩展性下降。本文提出TransIP:基于Transformer的原子间势能,一种无需显式架构约束即可实现对称性合规的新训练范式。该方法通过优化嵌入空间中的表示,引导通用非等变Transformer模型学习SO(3)等变性。在专为MLIP设计的大型多样分子数据集Open Molecules (OMol25) 上训练,涵盖小有机分子、生物片段及电解质类物种,TransIP在机器学习力场性能上与现有顶尖等变基线相当。相比数据增强基线,在不同大小的OMol25数据集上性能提升40%至60%。更广泛地,本工作表明学习到的等变性可成为等变或增强基方法的强大高效替代方案。代码已公开:https://github.com/Ahmed-A-A-Elhag/TransIP。

原文摘要 · Abstract (English)

Accurate and scalable machine-learned inter-atomic potentials (MLIPs) are essential for molecular simulations ranging from drug discovery to new material design. Current state-of-the-art models enforce roto-translational symmetries through equivariant neural network architectures, a hard-wired inductive bias that can often lead to reduced flexibility, computational efficiency, and scalability. In this work, we introduce TransIP: Transformer-based Inter-Atomic Potentials, a novel training paradigm for interatomic potentials achieving symmetry compliance without explicit architectural constraints. Our approach guides a generic non-equivariant Transformer-based model to learn SO(3)-equivariance by optimizing its representations in the embedding space. Trained on the recent Open Molecules (OMol25) collection, a large and diverse molecular dataset built specifically for MLIPs and covering different types of molecules (including small organics, biomolecular fragments, and electrolyte-like species), TransIP attains comparable performance in machine-learning force fields versus state-of-the-art equivariant baselines. Further, compared to a data augmentation baseline, TransIP achieves 40% to 60% improvement in performance across varying OMol25 dataset sizes. More broadly, our work shows that learned equivariance can be a powerful and efficient alternative to equivariant or augmentation-based MLIP models. Our code is available at: https://github.com/Ahmed-A-A-Elhag/TransIP.

分子模拟Transformer势能模型对称性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。