arXiv:2503.06151cs.CV2025-03被引 1

用生物力学先验生成更真实的动作,无需仿真环境。

Biomechanics-Guided Residual Approach to Generalizable Human Motion Generation and Estimation

  • 融合肌电与运动约束,不依赖仿真生成真实动作
  • 与扩散模型结合,实现稳定端到端训练
  • 在多个任务中表现卓越,适合动画与机器人应用

人体姿态、动作与运动生成对数字人、角色动画和人形机器人至关重要。然而,现有方法常难以生成符合生物力学原理的物理合理动作。尽管近期自回归与扩散模型在视觉质量上表现优异,却常忽略关键生物动力学特征,无法保证动作真实性。强化学习虽可弥补此不足,但高度依赖仿真环境,泛化能力受限。为此,我们提出 BioVAE,一种生物力学感知框架,包含三大创新:(1) 融合肌肉肌电(EMG)信号与运动学特征,并引入加速度约束,实现在无仿真条件下生成物理合理的动作;(2) 与扩散模型无缝耦合,支持稳定端到端训练;(3) 引入生物力学先验,显著提升在多样化运动生成与估计任务中的泛化能力。大量实验表明,BioVAE 在多个基准测试中达到领先性能,弥合了数据驱动运动合成与生物力学真实性之间的差距,树立了物理准确运动生成与姿态估计的新标准。

原文摘要 · Abstract (English)

Human pose, action, and motion generation are critical for applications in digital humans, character animation, and humanoid robotics. However, many existing methods struggle to produce physically plausible movements that are consistent with biomechanical principles. Although recent autoregressive and diffusion models deliver impressive visual quality, they often neglect key biodynamic features and fail to ensure physically realistic motions. Reinforcement Learning (RL) approaches can address these shortcomings but are highly dependent on simulation environments, limiting their generalizability. To overcome these challenges, we propose BioVAE, a biomechanics-aware framework with three core innovations: (1) integration of muscle electromyography (EMG) signals and kinematic features with acceleration constraints to enable physically plausible motion without simulations; (2) seamless coupling with diffusion models for stable end-to-end training; and (3) biomechanical priors that promote strong generalization across diverse motion generation and estimation tasks. Extensive experiments demonstrate that BioVAE achieves state-of-the-art performance on multiple benchmarks, bridging the gap between data-driven motion synthesis and biomechanical authenticity while setting new standards for physically accurate motion generation and pose estimation.

动作生成生物力学扩散模型姿态估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。