用确定性去噪提升3D分子生成效率,解决采样慢、不一致问题。
Breaking the Bottlenecks: Scalable Diffusion Models for 3D Molecular Generation
- 基于逆转移核框架,将确定性去噪统一为概率形式
- 在GEOM-DRUGS上实现更快收敛与更高结构保真度
- 适合需要高效高质分子生成的研究者使用
扩散模型在分子设计中展现出强大能力,能捕捉复杂结构分布并生成高质量3D分子。但其广泛应用受限于长采样轨迹、反向过程的随机方差以及去噪动态中结构感知不足。直接去噪扩散模型(DDDM)通过用确定性去噪步骤替代随机反向MCMC更新,显著缩短推理时间。然而,该方法的理论基础长期模糊。本文基于Huang等2024年提出的逆转移核(RTK)框架,对DDDM进行原理性重解释,将确定性与随机扩散统一于同一概率形式下。我们证明,直接去噪过程隐式优化了噪声样本与干净样本间的结构化传输映射。这一视角阐明了确定性去噪为何高效。此外,该框架确保数值稳定性,消除随机方差,支持可扩展且保持SE(3)等变性的去噪器。实验表明,基于RTK的确定性去噪在GEOM-DRUGS数据集上比随机扩散模型收敛更快、结构保真度更高,同时保持化学有效性。代码、模型与数据集已公开。
原文摘要 · Abstract (English)
Diffusion models have emerged as a powerful class of generative models for molecular design, capable of capturing complex structural distributions and achieving high fidelity in 3D molecule generation. However, their widespread use remains constrained by long sampling trajectories, stochastic variance in the reverse process, and limited structural awareness in denoising dynamics. The Directly Denoising Diffusion Model (DDDM) mitigates these inefficiencies by replacing stochastic reverse MCMC updates with deterministic denoising step, substantially reducing inference time. Yet, the theoretical underpinnings of such deterministic updates have remained opaque. In this work, we provide a principled reinterpretation of DDDM through the lens of the Reverse Transition Kernel (RTK) framework by Huang et al. 2024, unifying deterministic and stochastic diffusion under a shared probabilistic formalism. By expressing the DDDM reverse process as an approximate kernel operator, we show that the direct denoising process implicitly optimizes a structured transport map between noisy and clean samples. This perspective elucidates why deterministic denoising achieves efficient inference. Beyond theoretical clarity, this reframing resolves several long-standing bottlenecks in molecular diffusion. The RTK view ensures numerical stability by enforcing well-conditioned reverse kernels, improves sample consistency by eliminating stochastic variance, and enables scalable and symmetry-preserving denoisers that respect SE(3) equivariance. Empirically, we demonstrate that RTK-guided deterministic denoising achieves faster convergence and higher structural fidelity than stochastic diffusion models, while preserving chemical validity across GEOM-DRUGS dataset. Code, models, and datasets are publicly available in our project repository.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。