提出商空间扩散模型,高效处理分子生成中的对称性问题。
Quotient-Space Diffusion Models

- 在商空间中建模生成过程,消除对称冗余
- 小分子和蛋白质生成性能全面超越现有方法
- 适合需要精确对称性的分子结构生成任务
基于扩散的生成模型已重塑生成式AI,并在科学领域催生新能力,如快速生成分子3D结构。此类任务常存在对称性,即某些变换下的元素可视为等价。等变扩散模型虽能保证对称分布,却未能简化学习;基于对齐的简化方法则无法保留目标分布。本文提出商空间扩散模型,一种原则性框架,以完整处理并利用对称性。通过在商空间中进行内在生成建模,精确去除对称冗余,使模型输出可在等价类内任意移动,同时确保生成正确对称的目标分布。我们在遵循SE(3)(刚体运动)对称性的分子结构生成任务中实例化该框架,性能优于等变扩散模型,且在小分子和蛋白质生成上普遍超越对齐基方法,代表了生成模型中对称性处理的新范式。
原文摘要 · Abstract (English)
Diffusion-based generative models have reformed generative AI, and also enabled new capabilities in the science domain, e.g., fast generation of 3D structures of molecules. In such tasks, there is often a symmetry in the system, identifying elements that can be converted by certain transformations as equivalent. Equivariant diffusion models guarantee a symmetric distribution, but miss the opportunity to make learning easier, while alignment-based simplification attempts fail to preserve the target distribution. In this work, we develop quotient-space diffusion models, a principled generative framework to fully handle and leverage symmetry. By viewing the intrinsic generation process on the quotient space, the exact construction that removes symmetry redundancy, the framework simplifies learning by allowing model output to have an arbitrary intra-equivalence-class movement, while generating the correct symmetric target distribution with guarantee. We instantiate the framework for molecular structure generation which follows $\mathrm{SE}(3)$ (rigid-body movement) symmetry. It improves the performance over equivariant diffusion models and outperforms alignment-based methods universally for small molecules and proteins, representing a new framework that surpasses previous symmetry treatments in generative models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。