用环境参数直接指导生成,高效实现物理逼真的动作
SimDiff: Simulator-constrained Diffusion Model for Physically Plausible Motion Generation
- 将重力风速等环境参数嵌入去噪过程,替代反复调用模拟器
- 生成动作物理真实,且推理速度比传统方法快数倍
- 能灵活控制不同物理条件,支持未见组合的泛化
生成物理上合理的动作对角色动画和虚拟现实等应用至关重要。现有方法通常在扩散过程中引入基于模拟器的动作投影层以保证物理真实性,但因模拟器的串行特性,计算开销大,难以并行。我们发现,这种模拟器投影可视为扩散过程中的某种引导(分类器或无分类器)。基于此,我们提出 SimDiff,一种将环境参数(如重力、风速)直接融入去噪过程的模拟器约束扩散模型。通过条件化这些参数,SimDiff 能高效生成物理合理动作,无需推理时重复调用模拟器,并可精细调控不同物理系数。此外,SimDiff 成功推广至未见过的环境参数组合,展现出组合泛化能力。
原文摘要 · Abstract (English)
Generating physically plausible human motion is crucial for applications such as character animation and virtual reality. Existing approaches often incorporate a simulator-based motion projection layer to the diffusion process to enforce physical plausibility. However, such methods are computationally expensive due to the sequential nature of the simulator, which prevents parallelization. We show that simulator-based motion projection can be interpreted as a form of guidance, either classifier-based or classifier-free, within the diffusion process. Building on this insight, we propose SimDiff, a Simulator-constrained Diffusion Model that integrates environment parameters (e.g., gravity, wind) directly into the denoising process. By conditioning on these parameters, SimDiff generates physically plausible motions efficiently, without repeated simulator calls at inference, and also provides fine-grained control over different physical coefficients. Moreover, SimDiff successfully generalizes to unseen combinations of environmental parameters, demonstrating compositional generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。