让时间不准的关键帧也能生成自然流畅的动画。
Generative Motion Infilling From Imprecisely Timed Keyframes
- 用时间扭曲函数自动修正关键帧时间偏差
- 生成动作自然、时序合理且细节丰富的运动
- 适合动画师快速原型设计,无需精确调时
关键帧是运动描述的标准方式。现有生成式补间方法依赖精确对齐的姿势与时间,但实际中准确设定关键帧时间极为繁琐。本文提出一种新方法,可在生成过程中自动重定时关键帧。通过新型模型架构,显式输出时间扭曲函数以校正时间偏差,并结合空间残差添加姿态细节。实验表明,该方法能将大致定时的关键帧转化为多样、真实且时序合理的动作,包含精细子动作,显著提升生成质量。
原文摘要 · Abstract (English)
Keyframes are a standard representation for kinematic motion specification. Recent learned motion-inbetweening methods use keyframes as a way to control generative motion models, and are trained to generate life-like motion that matches the exact poses and timings of input keyframes. However, the quality of generated motion may degrade if the timing of these constraints is not perfectly consistent with the desired motion. Unfortunately, correctly specifying keyframe timings is a tedious and challenging task in practice. Our goal is to create a system that synthesizes high-quality motion from keyframes, even if keyframes are imprecisely timed. We present a method that allows constraints to be retimed as part of the generation process. Specifically, we introduce a novel model architecture that explicitly outputs a time-warping function to correct mistimed keyframes, and spatial residuals that add pose details. We demonstrate how our method can automatically turn approximately timed keyframe constraints into diverse, realistic motions with plausible timing and detailed submovements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。