提出因果扩散模型,实现流畅实时的人体动作生成。
Causal Motion Diffusion Models for Autoregressive Motion Generation
- 基于因果扩散Transformer,在语义对齐的潜空间中逐帧生成动作。
- 在HumanML3D和SnapMoGen上优于现有方法,延迟降低50%以上。
- 支持文本到动作、流式合成与长序列生成,适合交互应用。
近期动作扩散模型显著提升了人体动作合成的逼真度。然而,现有方法或依赖全序列双向生成,破坏时间因果性且无法实时应用;或采用自回归模型,存在不稳定性与误差累积问题。本文提出因果动作扩散模型(CMDM),一种基于因果扩散Transformer的统一自回归动作生成框架,其在语义对齐的潜空间中运行。该框架基于运动-语言对齐因果变分自编码器(MAC-VAE),将动作序列编码为时序因果潜表示。在此基础上,通过因果扩散强制训练自回归扩散Transformer,实现动作帧间的时序去噪。为加速推理,引入帧级采样调度与因果不确定性机制,使后续帧基于部分去噪前序帧预测。所提框架支持高质量文本到动作生成、流式合成与长时序动作生成,达到交互速率。在HumanML3D和SnapMoGen数据集上的实验表明,CMDM在语义保真度与时间平滑性上优于现有扩散与自回归模型,同时显著降低推理延迟。
原文摘要 · Abstract (English)
Recent advances in motion diffusion models have substantially improved the realism of human motion synthesis. However, existing approaches either rely on full-sequence diffusion models with bidirectional generation, which limits temporal causality and real-time applicability, or autoregressive models that suffer from instability and cumulative errors. In this work, we present Causal Motion Diffusion Models (CMDM), a unified framework for autoregressive motion generation based on a causal diffusion transformer that operates in a semantically aligned latent space. CMDM builds upon a Motion-Language-Aligned Causal VAE (MAC-VAE), which encodes motion sequences into temporally causal latent representations. On top of this latent representation, an autoregressive diffusion transformer is trained using causal diffusion forcing to perform temporally ordered denoising across motion frames. To achieve fast inference, we introduce a frame-wise sampling schedule with causal uncertainty, where each subsequent frame is predicted from partially denoised previous frames. The resulting framework supports high-quality text-to-motion generation, streaming synthesis, and long-horizon motion generation at interactive rates. Experiments on HumanML3D and SnapMoGen demonstrate that CMDM outperforms existing diffusion and autoregressive models in both semantic fidelity and temporal smoothness, while substantially reducing inference latency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。