让虚拟角色实时响应物理冲击,生成自然连续的动作。
PRIMAL: Physically Reactive and Interactive Motor Model for Avatar Learning
- 分两阶段训练:先无监督学习海量动作片段,再用控制网络适配新任务。
- 单帧初始状态即可生成无限时长、真实且可控的运动,响应延迟低于50毫秒。
- 适合游戏/动画领域,实现高响应性角色驱动,支持个性化动作生成。
我们将交互式虚拟角色的运动系统建模为一个生成式运动模型,能够以持续、真实、可控且响应迅速的方式驱动身体在三维空间中运动。尽管人类动作生成已广泛研究,但许多现有方法缺乏真实人体运动的响应性与自然性。受基础模型进展启发,我们提出PRIMAL,采用两阶段范式进行训练。预训练阶段,模型从大量亚秒级动作片段中无监督学习身体运动,构建生成基础;推理时仅需单帧初始状态,即可生成无限时长、逼真且可控制的运动,并实时响应外部冲击。在适配阶段,我们引入类ControlNet的适配器,高效微调基础模型,使其适应少样本个性化动作生成与空间目标抓取等新任务。评估表明,该方法优于现有最先进基线。我们进一步将其集成至Unreal Engine,构建了实时角色动画系统,表现出高度自然与响应灵敏。代码、模型及更多结果见:https://yz-cnsdqz.github.io/eigenmotion/PRIMAL
原文摘要 · Abstract (English)
We formulate the motor system of an interactive avatar as a generative motion model that can drive the body to move through 3D space in a perpetual, realistic, controllable, and responsive manner. Although human motion generation has been extensively studied, many existing methods lack the responsiveness and realism of real human movements. Inspired by recent advances in foundation models, we propose PRIMAL, which is learned with a two-stage paradigm. In the pretraining stage, the model learns body movements from a large number of sub-second motion segments, providing a generative foundation from which more complex motions are built. This training is fully unsupervised without annotations. Given a single-frame initial state during inference, the pretrained model not only generates unbounded, realistic, and controllable motion, but also enables the avatar to be responsive to induced impulses in real time. In the adaptation phase, we employ a novel ControlNet-like adaptor to fine-tune the base model efficiently, adapting it to new tasks such as few-shot personalized action generation and spatial target reaching. Evaluations show that our proposed method outperforms state-of-the-art baselines. We leverage the model to create a real-time character animation system in Unreal Engine that feels highly responsive and natural. Code, models, and more results are available at: https://yz-cnsdqz.github.io/eigenmotion/PRIMAL
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。