arXiv:2506.15290cs.GRcs.AI2025-06IJCAI被引 5

用松散佩戴的传感器实现全身动作捕捉,突破传统紧贴穿戴限制。

Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models

  • 基于扩散模型模拟松散传感器数据,结合人体服装信息建模
  • 在模拟与合成数据上训练,性能超越现有最先进方法
  • 适合真实场景下非紧贴式可穿戴设备的动作追踪研究

使用稀疏惯性测量单元(IMU)进行动作捕捉因其便携性和无遮挡优势而备受关注。现有方法通常假设传感器紧密贴合身体,但现实场景中常不成立。本文提出一种名为GaIP的方法,通过仿真现有带服装感知的人体运动数据生成松散佩戴的IMU信号,并利用基于Transformer的扩散模型从这些挑战性数据中估计全身姿态。实验表明,训练时引入服装相关参数能有效保持表达能力并捕捉松紧不同服装带来的变化。在模拟与合成数据上训练的扩散模型在定量和定性评估中均优于当前最优惯性全身姿态估计算法,为未来基于真实传感器布置的动作捕捉研究提供了新方向。

原文摘要 · Abstract (English)

Motion capture using sparse inertial sensors has shown great promise due to its portability and lack of occlusion issues compared to camera-based tracking. Existing approaches typically assume that IMU sensors are tightly attached to the human body. However, this assumption often does not hold in real-world scenarios. In this paper, we present Garment Inertial Poser (GaIP), a method for estimating full-body poses from sparse and loosely attached IMU sensors. We first simulate IMU recordings using an existing garment-aware human motion dataset. Our transformer-based diffusion models synthesize loose IMU data and estimate human poses from this challenging loose IMU data. We also demonstrate that incorporating garment-related parameters during training on loose IMU data effectively maintains expressiveness and enhances the ability to capture variations introduced by looser or tighter garments. Our experiments show that our diffusion methods trained on simulated and synthetic data outperform state-of-the-art inertial full-body pose estimators, both quantitatively and qualitatively, opening up a promising direction for future research on motion capture from such realistic sensor placements.

动作捕捉扩散模型可穿戴设备

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。