无需新增参数,通过多准则引导提升动作生成多样性。
A Plug-and-Play Multi-Criteria Guidance for Diverse In-Betweening Human Motion Generation
- 将采样过程转为多准则优化,动态平衡多样性和流畅性。
- 在四个数据集上优于当前最优方法,批量生成差异显著。
- 兼容扩散模型、VAE、GAN等多种生成模型,即插即用。
在关键帧之间生成过渡动作旨在合成从用户指定关键帧过渡的中间动作序列。除了保持平滑过渡外,该任务的关键要求是生成多样化的动作序列。由于复杂的运动动力学,保持多样性仍具挑战性,尤其当批量生成的动作需显著相异时。本文提出一种新方法——基于过渡动作模型的多准则引导(MCG-IMM),用于在关键帧间生成人类动作。其核心优势在于即插即用:在不引入额外参数的情况下,增强预训练模型生成动作的多样性。通过将预训练生成模型的采样过程重构为多准则优化问题,并引入优化流程,探索满足多样性与平滑性等多重条件的动作序列。所提方法兼容多种生成模型家族,包括去噪扩散概率模型、变分自编码器和生成对抗网络。在四个主流人体动作数据集上的实验表明,MCG-IMM在该任务中持续优于当前最优方法。
原文摘要 · Abstract (English)
In-betweening human motion generation aims to synthesize intermediate motions that transition between user-specified keyframes. In addition to maintaining smooth transitions, a crucial requirement of this task is to generate diverse motion sequences. It is still challenging to maintain diversity, particularly when it is necessary for the motions within a generated batch sampling to differ meaningfully from one another due to complex motion dynamics. In this paper, we propose a novel method, termed the Multi-Criteria Guidance with In-Betweening Motion Model (MCG-IMM), for in-betweening human motion generation. A key strength of MCG-IMM lies in its plug-and-play nature: it enhances the diversity of motions generated by pretrained models without introducing additional parameters This is achieved by providing a sampling process of pretrained generative models with multi-criteria guidance. Specifically, MCG-IMM reformulates the sampling process of pretrained generative model as a multi-criteria optimization problem, and introduces an optimization process to explore motion sequences that satisfy multiple criteria, e.g., diversity and smoothness. Moreover, our proposed plug-and-play multi-criteria guidance is compatible with different families of generative models, including denoised diffusion probabilistic models, variational autoencoders, and generative adversarial networks. Experiments on four popular human motion datasets demonstrate that MCG-IMM consistently state-of-the-art methods in in-betweening motion generation task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。