用拉格朗日粒子思想生成长时序动作,更高效更真实。
Lagrangian Motion Fields for Long-term Motion Generation

- 将关节视为粒子,用短时匀速运动建模,压缩动作表示
- 在音乐到舞蹈、文本到动作任务中提升生成质量与多样性
- 无需神经网络预处理,适合长循环与精细控制场景
长时序动作生成是一项挑战性任务,需在长时间跨度上生成连贯且逼真的动作序列。现有方法多依赖帧级动作表示,仅捕捉静态空间信息,忽略时间动态,导致时间维度冗余严重,难以生成有效长时动作。为此,我们提出全新的拉格朗日运动场(Lagrangian Motion Fields)概念,专为长时动作生成设计。通过将每个关节视为短时区间内匀速运动的拉格朗日粒子,我们的方法将动作表示压缩为一系列“超动作”(类似超像素)。该方法自然融合静态空间信息与可解释的时间动态,突破现有网络架构与动作内容类型的限制。本方案兼具通用性与轻量性,无需神经网络预处理。在音乐到舞蹈、文本到动作生成等任务中,相比现有方法展现出更高的效率、更优的生成质量与更大的多样性。此外,其灵活性还适用于无限循环动作生成与细粒度控制生成,凸显广泛适用性。视频演示见:https://plyfager.github.io/LaMoG。
原文摘要 · Abstract (English)
Long-term motion generation is a challenging task that requires producing coherent and realistic sequences over extended durations. Current methods primarily rely on framewise motion representations, which capture only static spatial details and overlook temporal dynamics. This approach leads to significant redundancy across the temporal dimension, complicating the generation of effective long-term motion. To overcome these limitations, we introduce the novel concept of Lagrangian Motion Fields, specifically designed for long-term motion generation. By treating each joint as a Lagrangian particle with uniform velocity over short intervals, our approach condenses motion representations into a series of "supermotions" (analogous to superpixels). This method seamlessly integrates static spatial information with interpretable temporal dynamics, transcending the limitations of existing network architectures and motion sequence content types. Our solution is versatile and lightweight, eliminating the need for neural network preprocessing. Our approach excels in tasks such as long-term music-to-dance generation and text-to-motion generation, offering enhanced efficiency, superior generation quality, and greater diversity compared to existing methods. Additionally, the adaptability of Lagrangian Motion Fields extends to applications like infinite motion looping and fine-grained controlled motion generation, highlighting its broad utility. Video demonstrations are available at https://plyfager.github.io/LaMoG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。