arXiv:2506.15378cs.LG2025-06NeurIPS被引 5

用扩散Transformer生成分子构象,精度领先且高效。

Sampling 3D Molecular Conformers with Diffusion Transformers

  • 分模块设计,分离3D坐标与原子连接条件处理
  • 在GEOM-QM9等数据集上达到最优精度和物理合理性
  • 支持灵活权衡精度与效率,适合分子结构生成任务

扩散Transformer(DiTs)在图像生成中表现优异,但在分子构象生成中面临新挑战:如何融合离散的分子图信息与连续的3D几何结构,处理欧几里得对称性,并设计可泛化于不同大小和结构分子的条件机制。本文提出DiTMC框架,通过模块化设计将3D坐标处理与原子连接条件分离。引入两种互补的基于图的条件策略,无缝集成至DiT架构,结合标准非等变与SO(3)-等变注意力机制,实现精度与计算效率的灵活权衡。在标准基准(GEOM-QM9、-DRUGS、-XL)上的实验表明,DiTMC在精度和物理有效性上均达到当前最佳水平。结果揭示了架构选择与对称性先验对生成质量与效率的影响,为大规模分子结构生成提供了新方向。代码已开源。

原文摘要 · Abstract (English)

Diffusion Transformers (DiTs) have demonstrated strong performance in generative modeling, particularly in image synthesis, making them a compelling choice for molecular conformer generation. However, applying DiTs to molecules introduces novel challenges, such as integrating discrete molecular graph information with continuous 3D geometry, handling Euclidean symmetries, and designing conditioning mechanisms that generalize across molecules of varying sizes and structures. We propose DiTMC, a framework that adapts DiTs to address these challenges through a modular architecture that separates the processing of 3D coordinates from conditioning on atomic connectivity. To this end, we introduce two complementary graph-based conditioning strategies that integrate seamlessly with the DiT architecture. These are combined with different attention mechanisms, including both standard non-equivariant and SO(3)-equivariant formulations, enabling flexible control over the trade-off between between accuracy and computational efficiency. Experiments on standard conformer generation benchmarks (GEOM-QM9, -DRUGS, -XL) demonstrate that DiTMC achieves state-of-the-art precision and physical validity. Our results highlight how architectural choices and symmetry priors affect sample quality and efficiency, suggesting promising directions for large-scale generative modeling of molecular structures. Code is available at https://github.com/ML4MolSim/dit_mc.

扩散模型分子生成3D建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。