用凸优化融合多视角人体姿态,实现实时高精度跟踪。
COMETH: Convex Optimization for Multiview Estimation and Tracking of Humans
- 引入运动学与生物力学约束提升关节定位精度
- 基于凸优化实现空间一致性姿态融合,误差降低18%
- 适合工业场景中资源受限的实时人体追踪
在工业5.0时代,监控人类活动对保障人机协作安全与整体福祉至关重要。尽管多相机集中式系统能提升姿态估计精度,但其计算开销大、带宽需求高,限制了可扩展性与实时应用。将处理分布到边缘设备可减轻网络负载与计算压力,但受限于边缘资源,常导致精度下降,且分布式计算引发时空不一致问题。为此,我们提出COMETH(Convex Optimization for Multiview Estimation and Tracking of Humans),一种轻量级实时多视角人体姿态融合算法。该方法结合运动学与生物力学约束以提高关节定位精度;采用基于凸优化的逆运动学实现空间融合;并引入状态观测器增强时间一致性。我们在公开及工业数据集上评估了COMETH,其在定位、检测与跟踪精度上均优于现有先进方法。所提出的融合流程实现了高精度、可扩展的人体运动追踪,适用于工业及安全关键应用场景。代码已开源:https://github.com/PARCO-LAB/COMETH。
原文摘要 · Abstract (English)
In the era of Industry 5.0, monitoring human activity is essential for ensuring both ergonomic safety and overall well-being. While multi-camera centralized setups improve pose estimation accuracy, they often suffer from high computational costs and bandwidth requirements, limiting scalability and real-time applicability. Distributing processing across edge devices can reduce network bandwidth and computational load. On the other hand, the constrained resources of edge devices lead to accuracy degradation, and the distribution of computation leads to temporal and spatial inconsistencies. We address this challenge by proposing COMETH (Convex Optimization for Multiview Estimation and Tracking of Humans), a lightweight algorithm for real-time multi-view human pose fusion that relies on three concepts: it integrates kinematic and biomechanical constraints to increase the joint positioning accuracy; it employs convex optimization-based inverse kinematics for spatial fusion; and it implements a state observer to improve temporal consistency. We evaluate COMETH on both public and industrial datasets, where it outperforms state-of-the-art methods in localization, detection, and tracking accuracy. The proposed fusion pipeline enables accurate and scalable human motion tracking, making it well-suited for industrial and safety-critical applications. The code is publicly available at https://github.com/PARCO-LAB/COMETH.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。