用超图优化解决多视角人体姿态估计,无需3D标注也能高精度定位。
COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation
- 将多视角人体姿态匹配建模为超图上的加权精确覆盖问题。
- 在无3D监督下,平均精度提升31点,超越现有最优方法。
- 适合追求零标注训练、高鲁棒性姿态估计的科研与工程应用。
从稀疏多视角相机阵列进行3D人体姿态估计是动作识别、体育分析和人机交互等应用的关键任务。尽管学习方法在基准测试中占主导地位,但需要大量带注释的数据;而免训练的优化方法通过求解2D检测结果间的对应关系绕过3D监督。现有组合方法依赖成对关联建模对应关系,并仅以后期约束保证全局一致性,但在遮挡和噪声检测下局部误差易传播至全局。本文提出COMPOSE,将多视角3D人体姿态估计重构为人物假设超图上的加权精确覆盖优化问题。该方法以单一全局组合目标取代成对匹配与事后一致性校验。为应对指数级候选空间,引入几何剪枝策略,并设计两种互补求解器:精确整数线性规划与基于信念传播的可扩展松弛。在无任何3D监督条件下,COMPOSE相比最优优化方法平均精度提升31点,较自监督学习方法提升13点,验证了高阶组合关联在免训练多视角3D姿态估计中的有效性。
原文摘要 · Abstract (English)
3D human pose estimation from sparse multi-view camera rigs is an essential task for numerous applications, including action recognition, sports analysis, and human-robot interaction. While learned methods dominate the field on benchmarks, they require large annotated datasets; training-free optimization-based methods remain promising as they circumvent 3D supervision by solving a correspondence problem across views from 2D detections. Existing combinatorial formulations rely on pairwise associations to model this correspondence problem and enforce global consistency across views only as a downstream constraint. However, reconciling locally plausible pairwise matches becomes brittle under occlusion and noisy detections, where local errors propagate globally. We propose COMPOSE, which recasts multi-view 3D human pose estimation as a weighted exact-cover optimization over a hypergraph of person hypotheses. Our formulation replaces pairwise association and post-hoc consistency enforcement with a single global combinatorial objective. To address the exponentially large candidate space, we introduce a geometric pruning strategy alongside two complementary solvers: an exact Integer Linear Programming formulation and a scalable relaxation via Belief Propagation. Without any 3D supervision, COMPOSE improves average precision by up to 31 points over the best optimization-based method and 13 points over self-supervised learned methods, demonstrating the effectiveness of higher-order combinatorial association for training-free multi-view 3D human pose estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。