arXiv:2510.24464cs.CV2025-10被引 4

无需标定即可从普通摄像头实现高精度3D人体动作捕捉

Kineo: Calibration-Free Metric Motion Capture From Sparse RGB Cameras

  • 用现成检测器同时完成相机标定与3D重建,无需同步或校准
  • 相比之前方法,平移误差降83%-85%,旋转误差降86%-92%
  • 适合非专业人士在真实场景快速部署使用

无标记多视角动作捕捉常受限于精确相机标定需求,制约了非专家用户和真实场景的应用。现有免标定方法虽降低标定门槛,但存在计算开销大、重建精度低的问题。我们提出Kineo,一个全自动、免标定的无标记动作捕捉流水线,可处理由不同步、未标定的消费级RGB摄像头拍摄的视频。Kineo利用现成检测器获取的2D关键点,同时完成相机标定(含Brown-Conrady畸变参数)与3D关键点及稠密场景点云的度量尺度重建。通过置信度驱动的时空关键点采样策略与基于图的全局优化,确保在固定计算成本下保持鲁棒标定。我们还引入成对重投影一致性评分,量化3D重建可靠性以支持下游任务。在EgoHumans和Human3.6M数据集上的评估显示,相比先前最优方法,Kineo将相机平移误差降低约83-85%,角度误差降低86-92%,世界空间平均关节误差(W-MPJPE)降低83-91%。在实际场景中高效运行,例如36分钟可处理1小时20分钟的视频流。完整代码与评测脚本已开源,网址:https://liris-xr.github.io/kineo/

原文摘要 · Abstract (English)

Markerless multiview motion capture is often constrained by the need for precise camera calibration, limiting accessibility for non-experts and in-the-wild captures. Existing calibration-free approaches mitigate this requirement but suffer from high computational cost and reduced reconstruction accuracy. We present Kineo, a fully automatic, calibration-free pipeline for markerless motion capture from videos captured by unsynchronized, uncalibrated, consumer-grade RGB cameras. Kineo leverages 2D keypoints from off-the-shelf detectors to simultaneously calibrate cameras, including Brown-Conrady distortion coefficients, and reconstruct 3D keypoints and dense scene point maps at metric scale. A confidence-driven spatio-temporal keypoint sampling strategy, combined with graph-based global optimization, ensures robust calibration at a fixed computational cost independent of sequence length. We further introduce a pairwise reprojection consensus score to quantify 3D reconstruction reliability for downstream tasks. Evaluations on EgoHumans and Human3.6M demonstrate substantial improvements over prior calibration-free methods. Compared to previous state-of-the-art approaches, Kineo reduces camera translation error by approximately 83-85%, camera angular error by 86-92%, and world mean-per-joint error (W-MPJPE) by 83-91%. Kineo is also efficient in real-world scenarios, processing multi-view sequences faster than their duration in specific configuration (e.g., 36min to process 1h20min of footage). The full pipeline and evaluation code are openly released to promote reproducibility and practical adoption at https://liris-xr.github.io/kineo/.

动作捕捉免标定多视角实时处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。