通过微分同胚优化,让生成模型在数据流形上更稳定地训练,提升蛋白质设计效果。
Diffeomorphic Optimization

- 利用扩散模型将复杂流形映射到简单空间,实现保持流形结构的梯度下降
- 在蛋白质结构设计中达到91.3%残基符合目标构象,显著优于传统方法
- 支持三维旋转与刚体运动群的自动微分,适合高精度分子生成任务
生成模型学习高维空间中低维流形上的数据分布。在该流形上优化可微目标极具挑战:环境损失面维度高、崎岖且非凸。直接梯度下降因无视流形几何而迅速偏离。微分同胚优化基于扩散与流模型提供从数据流形到更简单基空间的映射,在其上执行梯度下降。通过微分几何证明,这等价于对数据流形的黎曼梯度下降,误差在λ²阶内,能构造性保持轨迹在流形上,使优化面更平滑。针对蛋白质设计,将该方法扩展至矩阵李群SO(3)和SE(3),推导出SO(3)的自动微分梯度及用于李群常微分方程求解器的广义伴随态方法。实验显示,该方法在帧流(FrameFlow)中实现91.3%残基命中罗马查兰德目标,优于调优引导的63.3%;在肽结合亲和力任务上速度提升2倍且性能超越OC-Flow;在包含数百残基的PDB测试集上,降低数千单位的Rosetta能量。
原文摘要 · Abstract (English)
Generative models learn data distributions that reside on a low-dimensional manifold within a higher-dimensional ambient space. Optimizing differentiable objectives on this manifold is challenging: the ambient loss landscape is high-dimensional, rugged, and non-convex. Direct gradient descent, blind to the manifold's geometry, quickly drifts off it. Diffeomorphic optimization starts from the observation that diffusion and flow models provide a map from the data manifold to a much simpler base space in which we perform gradient descent. Using differential geometry, we show this is equivalent to Riemannian gradient descent on the data manifold up to $\mathcal{O}(λ^2)$ corrections, keeping trajectories on-manifold by construction and yielding a smoother optimization surface. For protein design, we extend diffeomorphic optimization to the matrix Lie groups $\mathrm{SO}(3)$ and $\mathrm{SE}(3)$, deriving an autograd-compatible $\mathrm{SO}(3)$ gradient and a generalized adjoint-state method for backpropagation through Lie-group ODE solvers. Diffeomorphic optimization improves over tuned guidance on secondary-structure targeting with FrameFlow ($91.3\%$ vs. $63.3\%$ of residues in the Ramachandran target), outperforms OC-Flow on peptide binding affinity at $2\times$ the speed, and reduces Rosetta energies by thousands of units across the PDB test set for structures with hundreds of residues.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。