arXiv:2510.27497cs.LGcs.AI2025-10中稿 · ICML被引 8

用惯性坐标系实现3D分子自回归生成,更准确且可控制。

InertialAR: Autoregressive 3D Molecule Generation with Inertial Frames

  • 将分子对齐到惯性坐标系并重排原子,生成唯一不变的序列
  • 在8个指标上超越基准,可控生成在5个指标达领先水平
  • 适合需要精确结构和功能控制的药物分子设计

基于Transformer的自回归模型已在文本与图像等模态中成为统一范式,但其在3D分子生成中的应用仍不充分。根源在于两个挑战:(1) 如何将分子转化为对SE(3)变换和原子索引排列均不变的1维标记序列;(2) 如何设计能建模耦合离散原子类型与连续3D坐标的混合标记的架构。为此,我们提出InertialAR。它首先通过将每个分子对齐至规范惯性坐标系并重排原子,实现面向生成的规范标记化,从而将任意3D结构转换为唯一的、对SE(3)和置换不变的标记序列。在此基础上,我们提出几何位置编码(GeoPE),赋予Transformer注意力以3D几何感知能力。最后,InertialAR采用分层自回归机制,依次预测下一个原子的类型和3D坐标,使用扩散损失进行优化。实验表明,在QM9、GEOM-Drugs和B3LYP数据集上,InertialAR在10项评估指标中有8项达到当前最优表现;在针对特定化学功能的可控生成中,于全部5项指标上均取得领先。代码已开源。

原文摘要 · Abstract (English)

Transformer-based autoregressive models have emerged as a unifying paradigm across modalities such as text and images, but their extension to 3D molecule generation remains underexplored. The gap stems from two fundamental challenges: (1) how to tokenize molecules into a canonical 1D sequence of tokens that is invariant to both SE(3) transformations and atom index permutations, and (2) how to design an architecture capable of modeling hybrid atom-based tokens that couple discrete atom types with continuous 3D coordinates. To address these challenges, we introduce InertialAR. It first performs generation-oriented canonical tokenization by aligning each molecule to a canonical inertial frame and reordering atoms, thereby converting arbitrary 3D structures into a unique, SE(3)- and permutation-invariant sequence of tokens for autoregressive generation. Built upon this canonical tokenization, we propose geometric positional encoding (GeoPE), which endows Transformer attention with 3D geometric awareness. Finally, InertialAR utilizes a hierarchical autoregressive paradigm to decode the next atom, consecutively predicting the atom type and 3D coordinates via Diffusion Loss. Experimentally, InertialAR achieves state-of-the-art performance on 8 of the 10 evaluation metrics for unconditional generation across QM9, GEOM-Drugs, and B3LYP. Moreover, it significantly outperforms baselines in controllable generation for targeted chemical functionality, attaining state-of-the-art results across all 5 metrics. Code is available at github.com/HaoruiLi46/InertialAR.

3D分子生成自回归几何感知药物设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。