arXiv:2410.13027cs.CVcs.LG2024-10NeurIPS被引 19

首个生成3D几何轨迹的扩散模型,能捕捉动态系统中的时空对称性。

Geometric Trajectory Diffusion Models

  • 用具备SE(3)等变特性的时空卷积与注意力设计新扩散核。
  • 在分子动力学、行人运动等场景中生成轨迹质量显著提升。
  • 适合需要模拟物理系统动态行为的研究者使用。

生成模型在生成3D几何系统方面展现出巨大潜力,这是分子与蛋白质设计等多个自然科学领域中的基础问题。然而,现有方法仅处理静态结构,忽略了物理系统本质上是动态的这一事实。本文提出几何轨迹扩散模型(GeoTDM),首个用于建模3D几何轨迹时间分布的扩散模型。该任务具有挑战性,需同时捕捉复杂空间相互作用与物理对称性,以及动态中的时间对应关系。我们理论证明:具有等变时间核的扩散模型可产生期望对称性的密度分布,并设计了新型转移核,融合SE(3)-等变空间卷积与时间注意力机制。为进一步增强条件生成的表达能力,我们在前向扩散过程中引入广义可学习几何先验以强化时间条件。我们在多种场景下进行大量实验,涵盖无条件与条件生成,包括物理模拟、分子动力学和行人运动。在一系列评估指标上,结果表明GeoTDM能生成质量显著更高的真实几何轨迹。

原文摘要 · Abstract (English)

Generative models have shown great promise in generating 3D geometric systems, which is a fundamental problem in many natural science domains such as molecule and protein design. However, existing approaches only operate on static structures, neglecting the fact that physical systems are always dynamic in nature. In this work, we propose geometric trajectory diffusion models (GeoTDM), the first diffusion model for modeling the temporal distribution of 3D geometric trajectories. Modeling such distribution is challenging as it requires capturing both the complex spatial interactions with physical symmetries and temporal correspondence encapsulated in the dynamics. We theoretically justify that diffusion models with equivariant temporal kernels can lead to density with desired symmetry, and develop a novel transition kernel leveraging SE(3)-equivariant spatial convolution and temporal attention. Furthermore, to induce an expressive trajectory distribution for conditional generation, we introduce a generalized learnable geometric prior into the forward diffusion process to enhance temporal conditioning. We conduct extensive experiments on both unconditional and conditional generation in various scenarios, including physical simulation, molecular dynamics, and pedestrian motion. Empirical results on a wide suite of metrics demonstrate that GeoTDM can generate realistic geometric trajectories with significantly higher quality.

3D生成扩散模型轨迹建模物理模拟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。