arXiv:2602.05755cs.CV2026-02被引 5

用流匹配加速单目3D姿态估计,生成更准更快的多种可能结果。

FMPose3D: monocular 3D pose estimation via flow matching

  • 通过微分方程连续传输分布,仅需几步即可生成3D姿态样本
  • 在Human3.6M和MPI-INF-3DHP上超越现有方法,动物姿态数据也达顶尖水平
  • 适合需要快速生成多解的实时3D姿态应用

单目3D姿态估计因深度模糊和遮挡问题本质上是病态的,促使人们采用生成多个合理姿态假设的概率方法。近期基于扩散模型的方法表现优异,但其迭代去噪过程通常需大量步数,导致推理计算成本高。本文提出FMPose3D,利用流匹配(FM)学习由常微分方程定义的速度场,仅需少数积分步骤即可高效生成3D姿态样本。该框架将3D姿态估计建模为条件分布传输问题,将标准高斯先验连续映射到仅依赖2D输入的合理3D姿态分布。尽管ODE轨迹确定,但通过不同噪声种子采样可自然生成多种姿态假设。为进一步从假设中获得单一准确预测,引入基于重投影的后验期望聚合模块(RPEA),近似3D假设上的贝叶斯后验期望。FMPose3D在广泛使用的人体姿态基准Human3.6M和MPI-INF-3DHP上优于现有方法,并在3D动物姿态数据集Animal3D和CtrlAni3D上达到最先进性能,展现跨3D姿态领域的强大表现力。代码已开源。

原文摘要 · Abstract (English)

Monocular 3D pose estimation is fundamentally ill-posed due to depth ambiguity and occlusions, thereby motivating probabilistic methods that generate multiple plausible 3D pose hypotheses. In particular, diffusion-based models have recently demonstrated strong performance, but their iterative denoising process typically requires many timesteps for each prediction, making inference computationally expensive. In contrast, we leverage Flow Matching (FM) to learn a velocity field defined by an Ordinary Differential Equation (ODE), enabling efficient generation of 3D pose samples with only a few integration steps. We propose a novel generative pose estimation framework, FMPose3D, that formulates 3D pose estimation as a conditional distribution transport problem. It continuously transports samples from a standard Gaussian prior to the distribution of plausible 3D poses conditioned only on 2D inputs. Although ODE trajectories are deterministic, FMPose3D naturally generates various pose hypotheses by sampling different noise seeds. To obtain a single accurate prediction from those hypotheses, we further introduce a Reprojection-based Posterior Expectation Aggregation (RPEA) module, which approximates the Bayesian posterior expectation over 3D hypotheses. FMPose3D surpasses existing methods on the widely used human pose estimation benchmarks Human3.6M and MPI-INF-3DHP, and further achieves state-of-the-art performance on the 3D animal pose datasets Animal3D and CtrlAni3D, demonstrating strong performance across both 3D pose domains. The code is available at https://github.com/AdaptiveMotorControlLab/FMPose3D.

3D姿态估计流匹配生成模型单目

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。