arXiv:2508.13562cs.CV2025-08被引 3

用神经网络替代传统优化,实现快速人体姿态估计。

Learnable SMPLify: A Neural Solution for Optimization-Free Human Pose Inverse Kinematics

  • 设计单次前向传播模型替代迭代优化,提升速度。
  • 比SMPLify快190倍以上,在多个数据集上表现稳定。
  • 可作为插件提升其他姿态估计算法效果,适用性强。

在3D人体姿态与形状估计中,SMPLify是鲁棒的基准方法,通过迭代优化求解逆运动学(IK),但计算开销大。近期研究表明,用数据驱动的神经网络替代迭代优化可在不损失精度的情况下显著提升运行速度。受此启发,我们提出Learnable SMPLify,一个将SMPLify的迭代拟合过程替换为单次回归模型的神经框架。该框架针对神经逆运动学中的两大挑战——数据构建与泛化能力——进行设计:提出时序采样策略,从连续帧中构建初始化-目标配对用于训练;采用以人体为中心的归一化与残差学习,缩小解空间,增强跨动作和未见姿态的泛化能力。该方法支持序列推理与插件式后处理,可提升现有基于图像的姿态估计算法性能。大量实验表明,本方法建立了一个实用且简洁的基线:相比SMPLify,运行速度提升近200倍,在3DPW和RICH等未见数据集上泛化良好,且作为插件工具在LucidAction上具备模型无关性。代码已开源。

原文摘要 · Abstract (English)

In 3D human pose and shape estimation, SMPLify remains a robust baseline that solves inverse kinematics (IK) through iterative optimization. However, its high computational cost limits its practicality. Recent advances across domains have shown that replacing iterative optimization with data-driven neural networks can achieve significant runtime improvements without sacrificing accuracy. Motivated by this trend, we propose Learnable SMPLify, a neural framework that replaces the iterative fitting process in SMPLify with a single-pass regression model. The design of our framework targets two core challenges in neural IK: data construction and generalization. To enable effective training, we propose a temporal sampling strategy that constructs initialization-target pairs from sequential frames. To improve generalization across diverse motions and unseen poses, we propose a human-centric normalization scheme and residual learning to narrow the solution space. Learnable SMPLify supports both sequential inference and plug-in post-processing to refine existing image-based estimators. Extensive experiments demonstrate that our method establishes itself as a practical and simple baseline: it achieves nearly 200x faster runtime compared to SMPLify, generalizes well to unseen 3DPW and RICH, and operates in a model-agnostic manner when used as a plug-in tool on LucidAction. The code is available at https://github.com/Charrrrrlie/Learnable-SMPLify.

姿态估计神经逆运动学高效建模单次推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。