用扩散模型生成更真实多样的人体动作,解决噪声导致动作失真问题。
DivDiff: A Conditional Diffusion Model for Diverse Human Motion Prediction
- 基于扩散模型,结合DCT与Transformer编码输入动作序列
- 设计强化骨骼约束的采样函数,减少前向过程噪声干扰
- 在Human3.6M和HumanEva-I数据集上实现高多样性与高精度
多样人体动作预测(HMP)旨在根据观测到的动作序列生成多个合理的未来动作。该任务因动作可能性多样而极具挑战性,同时需保证预测动作的准确性。现有方法或多样性不足,或表达能力有限。近期去噪扩散模型(DDPM)在生成任务中展现出潜力,但直接引入到多样HMP会引发问题:尽管能提升动作模式多样性,但由于前向过程中显著的噪声干扰,导致预测动作随时间逐渐变得不自然,难以控制,严重影响生成质量并限制实际应用。为此,本文提出一种新型条件扩散生成模型DivDiff,以生成更多样且真实的动作。具体而言,DivDiff以DDPM为骨干,结合离散余弦变换(DCT)和Transformer机制,将观测动作序列编码为条件信息以指导逆过程;更重要的是,设计了多样化强化采样函数(DRSF),利用人体骨骼结构作为先验知识,抑制前向过程中的显著噪声扰动。在两个常用数据集(Human3.6M和HumanEva-I)上的实验结果表明,该模型在多样性与准确性方面均达到竞争力水平。
原文摘要 · Abstract (English)
Diverse human motion prediction (HMP) aims to predict multiple plausible future motions given an observed human motion sequence. It is a challenging task due to the diversity of potential human motions while ensuring an accurate description of future human motions. Current solutions are either low-diversity or limited in expressiveness. Recent denoising diffusion models (DDPM) hold potential generative capabilities in generative tasks. However, introducing DDPM directly into diverse HMP incurs some issues. Although DDPM can increase the diversity of the potential patterns of human motions, the predicted human motions become implausible over time because of the significant noise disturbances in the forward process of DDPM. This phenomenon leads to the predicted human motions being hard to control, seriously impacting the quality of predicted motions and restricting their practical applicability in real-world scenarios. To alleviate this, we propose a novel conditional diffusion-based generative model, called DivDiff, to predict more diverse and realistic human motions. Specifically, the DivDiff employs DDPM as our backbone and incorporates Discrete Cosine Transform (DCT) and transformer mechanisms to encode the observed human motion sequence as a condition to instruct the reverse process of DDPM. More importantly, we design a diversified reinforcement sampling function (DRSF) to enforce human skeletal constraints on the predicted human motions. DRSF utilizes the acquired information from human skeletal as prior knowledge, thereby reducing significant disturbances introduced during the forward process. Extensive results received in the experiments on two widely-used datasets (Human3.6M and HumanEva-I) demonstrate that our model obtains competitive performance on both diversity and accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。