arXiv:2411.18303cs.CV2024-11ICCV被引 14

无需训练即可生成任意长度的人体动作序列。

InfiniDreamer: Arbitrarily Long Human Motion Generation via Segment Score Distillation

  • 分段生成+优化迭代,用短片段拼接长动作。
  • 利用预训练扩散模型对齐片段,保持局部连贯性。
  • 适合需要超长动作生成的动画、游戏开发场景。

我们提出 InfiniDreamer,一种可生成任意长度人体动作的新框架。现有方法受限于缺乏长序列训练数据,通常只能生成短动作。InfiniDreamer 首先根据文本描述生成子动作片段,并用随机初始化的过渡段拼接成粗略的长序列。随后引入无需训练的优化方法 Segment Score Distillation (SSD),通过迭代优化从粗序列中采样的重叠短片段,使其与仅在短片段上训练的运动扩散先验对齐。该过程确保每个片段内部的局部一致性,同时使片段间的过渡保持全局连贯性。大量定性和定量实验验证了该框架的优势,展示了其生成上下文感知、连贯性强的任意长度动作序列的能力。

原文摘要 · Abstract (English)

We present InfiniDreamer, a novel framework for arbitrarily long human motion generation. InfiniDreamer addresses the limitations of current motion generation methods, which are typically restricted to short sequences due to the lack of long motion training data. To achieve this, we first generate sub-motions corresponding to each textual description and then assemble them into a coarse, extended sequence using randomly initialized transition segments. We then introduce an optimization-based method called Segment Score Distillation (SSD) to refine the entire long motion sequence. SSD is designed to utilize an existing motion prior, which is trained only on short clips, in a training-free manner. Specifically, SSD iteratively refines overlapping short segments sampled from the coarsely extended long motion sequence, progressively aligning them with the pre-trained motion diffusion prior. This process ensures local coherence within each segment, while the refined transitions between segments maintain global consistency across the entire sequence. Extensive qualitative and quantitative experiments validate the superiority of our framework, showcasing its ability to generate coherent, contextually aware motion sequences of arbitrary length.

动作生成扩散模型长序列

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。