无需真实动作数据,用合成数据优化人体运动物理合理性。
Morph: A Motion-free Physics Optimization Framework for Human Motion Generation
- 用合成噪声数据训练物理优化模块,实现无运动依赖的物理约束修正。
- 在文本到动作和音乐到舞蹈任务中,物理合理性显著提升且质量达顶尖水平。
- 适合数字人、机器人控制等需自然物理动作的应用场景。
人体动作生成在数字人和人形机器人控制中至关重要,但现有方法常忽略物理约束,导致浮空、脚滑等不合理的动作。本文提出Morph——一种无需真实运动数据的物理优化框架,由动作生成器与物理精炼模块组成。动作生成器提供大规模合成噪声动作数据,物理精炼模块利用这些数据在物理模拟器中学习动作模仿器,强制施加物理约束,将噪声动作投影至物理合理空间。同时引入先验奖励模块提升优化稳定性,生成更平滑稳定的动作。这些优化后的动作用于微调生成器,形成协同增强闭环。在文本到动作和音乐到舞蹈任务上的实验表明,该框架在保持顶尖动作质量的同时,大幅提高物理合理性。项目页面:https://interestingzhuo.github.io/Morph-Page/。
原文摘要 · Abstract (English)
Human motion generation has been widely studied due to its crucial role in areas such as digital humans and humanoid robot control. However, many current motion generation approaches disregard physics constraints, frequently resulting in physically implausible motions with pronounced artifacts such as floating and foot sliding. Meanwhile, training an effective motion physics optimizer with noisy motion data remains largely unexplored. In this paper, we propose \textbf{Morph}, a \textbf{Mo}tion-F\textbf{r}ee \textbf{ph}ysics optimization framework, consisting of a Motion Generator and a Motion Physics Refinement module, for enhancing physical plausibility without relying on expensive real-world motion data. Specifically, the motion generator is responsible for providing large-scale synthetic, noisy motion data, while the motion physics refinement module utilizes these synthetic data to learn a motion imitator within a physics simulator, enforcing physical constraints to project the noisy motions into a physically-plausible space. Additionally, we introduce a prior reward module to enhance the stability of the physics optimization process and generate smoother and more stable motions. These physically refined motions are then used to fine-tune the motion generator, further enhancing its capability. This collaborative training paradigm enables mutual enhancement between the motion generator and the motion physics refinement module, significantly improving practicality and robustness in real-world applications. Experiments on both text-to-motion and music-to-dance generation tasks demonstrate that our framework achieves state-of-the-art motion quality while improving physical plausibility drastically. Project page: https://interestingzhuo.github.io/Morph-Page/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。