arXiv:2605.29953cs.CV2026-05

利用人体网格增强视图间匹配,无需训练即可精准估计篮球赛多视角多人3D姿态

Mesh-Aware Epipolar Matching for Multi-View Multi-Person 3D Pose Estimation in Basketball

论文配图:Mesh-Aware Epipolar Matching for Multi-View Multi-Person 3D Pose Estimation in Basketball
图 1 · 摘自论文原文
  • 基于恢复的3D人体网格,分两阶段进行视图间关键点匹配
  • 在两个篮球数据集上达到59.8/40.7mm和74.0/51.8mm的MPJPE/PA-MPJPE
  • 无需目标域训练,适用于室内外多种篮球场景

团队运动中多视角多人3D姿态估计仍面临球员遮挡、队服外观相似以及多视角标注数据稀缺等挑战,限制了学习方法的有效性与泛化能力。相比之下,免训练方法的性能受限于2D关键点检测精度和跨视角关联的鲁棒性。为此,本文提出无需训练的Mesh-Aware Epipolar Matching(MAEM)框架。该方法以单目3D人体网格恢复模型为前端,基于恢复的网格输出提出两阶段对极匹配策略。具体而言,结合并查集聚类与逐关节三角化,实现鲁棒的跨视角关联与精确的3D姿态重建。在两个公开的多视角篮球数据集上的实验表明,MAEM持续优于现有免训练关联基线,在室内与室外篮球场景中均达到具有竞争力的纯RGB性能。在SportCenter EPFL和Human-M3 Basketball数据集上分别取得59.8/40.7mm和74.0/51.8mm的MPJPE/PA-MPJPE,验证了密集网格几何在无目标域训练下提升跨视角关联的有效性。

原文摘要 · Abstract (English)

Multi-view multi-person 3D pose estimation in team sports scenarios remains challenging due to player occlusions, appearance similarity caused by team uniforms, and the scarcity of annotated multi-view data, all of which limit the effectiveness and generalization capability of learning-based methods. In contrast, the performance of training-free approaches is inherently constrained by the accuracy of 2D keypoint detection and the robustness of cross-view association. To address these challenges, we propose Mesh-Aware Epipolar Matching (MAEM), a training-free framework for multi-view multi-person 3D pose estimation. Our method employs a monocular 3D human mesh recovery model as the frontend and introduces a two-stage epipolar matching strategy based on the recovered mesh outputs. Specifically, the proposed framework combines disjoint-set-union-based clustering with per-joint triangulation to achieve robust cross-view association and accurate 3D pose reconstruction. Experiments on two public multi-view basketball datasets demonstrate that MAEM consistently outperforms existing training-free association baselines while achieving competitive RGB-only performance in both indoor and outdoor basketball scenarios. MAEM achieves MPJPE/PA-MPJPE scores of 59.8/40.7 mm on SportCenter EPFL and 74.0/51.8 mm on Human-M3 Basketball, highlighting the effectiveness of dense mesh geometry for cross-view association without requiring target-domain training or fine-tuning.

3D姿态估计多视角篮球分析免训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。