将SMPL人体模型重构为生物力学准确的骨骼结构,实现高精度人体姿态建模。
From Skin to Skeleton: Towards Biomechanically Accurate 3D Digital Humans
- 用生物力学骨架重置SMPL模型的关节结构,提升解剖真实性
- 在AMASS数据上优化骨骼位置,构建带真实关节标注的训练数据集
- 可直接用于现有数据集升级,适合生物力学与计算机图形学研究
现有基于神经网络的3D人体姿态与形状估计方法多依赖SMPL等参数化人体模型,但其关节结构简化,与真实骨骼系统不符,限制了在生物力学中的应用。而传统生物力学运动估计依赖昂贵的动捕系统和复杂优化。为此,本文提出SKEL模型,将SMPL模型重新布线为符合真实骨骼系统的结构。通过在AMASS序列上优化嵌入于SMPL网格内的生物力学骨架,构建包含多样化姿态下真实关节位置的数据集,并训练回归器从网格顶点预测优化后的关节位置与骨旋转。最终重构出具有更少自由度、但生物力学真实的可动画化模型。实验表明,SKEL在关节定位精度和骨骼与体表贴合度上优于SMPL及此前方法。通过将SKEL拟合至已有SMPL网格,可“升级”现有数据集以包含生物力学参数。模型代码与数据已公开:https://skel.is.tue.mpg.de。
原文摘要 · Abstract (English)
Great progress has been made in estimating 3D human pose and shape from images and video by training neural networks to directly regress the parameters of parametric human models like SMPL. However, existing body models have simplified kinematic structures that do not correspond to the true joint locations and articulations in the human skeletal system, limiting their potential use in biomechanics. On the other hand, methods for estimating biomechanically accurate skeletal motion typically rely on complex motion capture systems and expensive optimization methods. What is needed is a parametric 3D human model with a biomechanically accurate skeletal structure that can be easily posed. To that end, we develop SKEL, which re-rigs the SMPL body model with a biomechanics skeleton. To enable this, we need training data of skeletons inside SMPL meshes in diverse poses. We build such a dataset by optimizing biomechanically accurate skeletons inside SMPL meshes from AMASS sequences. We then learn a regressor from SMPL mesh vertices to the optimized joint locations and bone rotations. Finally, we re-parametrize the SMPL mesh with the new kinematic parameters. The resulting SKEL model is animatable like SMPL but with fewer, and biomechanically-realistic, degrees of freedom. We show that SKEL has more biomechanically accurate joint locations than SMPL, and the bones fit inside the body surface better than previous methods. By fitting SKEL to SMPL meshes we are able to "upgrade" existing human pose and shape datasets to include biomechanical parameters. SKEL provides a new tool to enable biomechanics in the wild, while also providing vision and graphics researchers with a better constrained and more realistic model of human articulation. The model, code, and data are available for research at https://skel.is.tue.mpg.de..
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。