用混合隐空间让角色动画更自然流畅,还能灵活适应各种控制任务。
Versatile Physics-based Character Control with Hybrid Latent Representation
- 结合离散与连续隐变量,构建可跨任务复用的运动先验。
- 生成动作平滑无抖动,支持稀疏目标条件下的自然运动。
- 适合需要高表达力的复杂角色控制,如头戴设备追踪。
我们提出一种多功能的隐表示方法,使物理模拟角色能高效利用运动先验。为构建共享于多个任务的强大运动嵌入,物理控制器需具备丰富且易于探索的隐空间,以生成高质量动作。本文通过融合连续与离散隐表示,构建可适配多种挑战性控制任务的通用运动先验。具体而言,采用离散隐模型捕捉具有区分性的后验分布,避免崩溃;同时在采样向量中加入连续残差,生成平滑无抖动的高质量动作。进一步引入残差向量量化(Residual Vector Quantization),不仅提升离散运动先验的容量,还在任务学习阶段高效抽象动作空间。实验表明,仅通过无条件遍历学习到的运动先验,代理即可生成多样且平滑的动作。此外,该模型在稀疏目标条件下仍能实现高度表达性的自然运动,包括头戴设备追踪和不规则间隔的运动插值,这是现有隐表示难以实现的。
原文摘要 · Abstract (English)
We present a versatile latent representation that enables physically simulated character to efficiently utilize motion priors. To build a powerful motion embedding that is shared across multiple tasks, the physics controller should employ rich latent space that is easily explored and capable of generating high-quality motion. We propose integrating continuous and discrete latent representations to build a versatile motion prior that can be adapted to a wide range of challenging control tasks. Specifically, we build a discrete latent model to capture distinctive posterior distribution without collapse, and simultaneously augment the sampled vector with the continuous residuals to generate high-quality, smooth motion without jittering. We further incorporate Residual Vector Quantization, which not only maximizes the capacity of the discrete motion prior, but also efficiently abstracts the action space during the task learning phase. We demonstrate that our agent can produce diverse yet smooth motions simply by traversing the learned motion prior through unconditional motion generation. Furthermore, our model robustly satisfies sparse goal conditions with highly expressive natural motions, including head-mounted device tracking and motion in-betweening at irregular intervals, which could not be achieved with existing latent representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。