将复杂动作拆解为可复用的模块化技能,提升角色运动控制的泛化能力。
ModSkill: Physical Character Skill Modularization
- 将全身动作分解为独立身体部位的模块化技能
- 在多个任务上实现更精准的全身动作追踪,成功率显著提升
- 适合需要灵活复用动作技能的虚拟角色控制系统
人类运动高度多样且动态,给模仿学习算法带来挑战,尤其在推广到大规模运动数据集时。现有方法通常依赖全局全身体控器或统一技能嵌入空间,但难以有效泛化和扩展。本文提出一种新框架 ModSkill,将复杂全身体感技能解耦为可组合的、模块化的局部身体技能。该框架引入技能模块化注意力层,将策略观测转化为指导各身体部位低级控制器的模块化技能嵌入。同时提出主动技能学习方法,结合生成式自适应采样,利用大模型在困难追踪场景中增强策略学习。实验表明,该模块化技能学习框架结合生成采样,在精确全身运动追踪方面优于现有方法,并支持多样化目标驱动任务中的技能复用。
原文摘要 · Abstract (English)
Human motion is highly diverse and dynamic, posing challenges for imitation learning algorithms that aim to generalize motor skills for controlling simulated characters. Previous methods typically rely on a universal full-body controller for tracking reference motion (tracking-based model) or a unified full-body skill embedding space (skill embedding). However, these approaches often struggle to generalize and scale to larger motion datasets. In this work, we introduce a novel skill learning framework, ModSkill, that decouples complex full-body skills into compositional, modular skills for independent body parts. Our framework features a skill modularization attention layer that processes policy observations into modular skill embeddings that guide low-level controllers for each body part. We also propose an Active Skill Learning approach with Generative Adaptive Sampling, using large motion generation models to adaptively enhance policy learning in challenging tracking scenarios. Our results show that this modularized skill learning framework, enhanced by generative sampling, outperforms existing methods in precise full-body motion tracking and enables reusable skill embeddings for diverse goal-driven tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。