用预训练扩散模型生成可复用的自然动作先验,无需重新训练。
SMP: Reusable Score-Matching Motion Priors for Physics-Based Character Control
- 基于扩散模型和得分蒸馏采样构建通用动作先验
- 在多种物理模拟人形角色任务中生成高质量自然动作
- 支持风格迁移与组合,适合快速适配新任务
数据驱动的动作先验在生成逼真虚拟角色行为中起关键作用。对抗性模仿学习虽有效,但多数需为每个新控制器重新训练,限制复用性且需保留原始动作数据。本文提出评分匹配动作先验(SMP),利用预训练动作扩散模型与得分蒸馏采样(SDS),创建与任务无关的可复用动作先验。SMP可在大规模动作数据集上独立预训练,训练后保持冻结,作为通用奖励函数用于训练新策略,生成自然动作。我们证明,一个通用先验可转化为多种风格特异性先验,并能组合生成原数据集中不存在的新风格。实验表明,SMP在多种物理模拟人形角色控制任务中表现优异,生成动作质量媲美最先进的对抗性模仿学习方法。视频见:https://youtu.be/jBA2tWk6vzU
原文摘要 · Abstract (English)
Data-driven motion priors that can guide agents toward producing naturalistic behaviors play a pivotal role in creating life-like virtual characters. Adversarial imitation learning has been a highly effective method for learning motion priors from reference motion data. However, adversarial priors, with few exceptions, need to be retrained for each new controller, thereby limiting their reusability and necessitating the retention of the reference motion data when applied to downstream tasks. In this work, we present Score-Matching Motion Priors (SMP), which leverages pre-trained motion diffusion models and score distillation sampling (SDS) to create reusable task-agnostic motion priors. SMPs can be pre-trained on a motion dataset, independent of any control policy or task. Once trained, SMPs can be kept frozen and reused as general-purpose reward functions to train new policies to produce naturalistic behaviors for downstream tasks. We show that a general motion prior trained on large-scale datasets can be repurposed into a variety of style-specific priors. Furthermore, SMP can compose different styles to synthesize new styles not present in the original dataset. Our method can create reusable and modular motion priors that produce high-quality motions comparable to state-of-the-art adversarial imitation learning methods. In our experiments, we demonstrate the effectiveness of SMP across a diverse suite of control tasks with physically simulated humanoid characters. Video available at https://youtu.be/jBA2tWk6vzU
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。