融合体操领域知识,提升多相机追踪精度
Enhancing Multi-Camera Gymnast Tracking Through Domain Knowledge Integration
- 结合体操动作规律,用射线与平面相交生成三维轨迹候选
- 在仅两个对向视角有效时仍能保持追踪稳定,减少失败率
- 已用于世锦赛裁判系统,获国际体联高度认可
我们提出一种鲁棒的多相机体操运动员追踪方法,已应用于国际体操锦标赛的裁判系统。尽管多相机追踪算法已有显著进展,但体操追踪面临独特挑战:(i) 场馆空间限制导致摄像机数量有限;(ii) 光照、背景、服装及遮挡变化导致某些视角检测失败,仅有两个对向视角可提供有效检测。这使得传统多相机三角测量难以准确确定运动员三维轨迹。为缓解此问题,我们在追踪方案中融入体操领域知识。鉴于运动员大部分动作期间其三维中心通常位于预设垂直平面内,我们采用射线-平面相交法生成共面三维轨迹候选。具体而言,提出一种新型级联数据关联(DA)范式:当跨视角检测充足时,使用三角测量生成三维轨迹候选;检测不足时,则依赖射线-平面相交。由此产生的共面候选用于补偿不确定轨迹,从而最小化追踪失败。大量实验验证了该方法在复杂场景下的优越性。此外,配备此追踪方法的体操裁判系统已成功应用于最近的世界体操锦标赛,获得国际体操联合会高度认可。
原文摘要 · Abstract (English)
We present a robust multi-camera gymnast tracking, which has been applied at international gymnastics championships for gymnastics judging. Despite considerable progress in multi-camera tracking algorithms, tracking gymnasts presents unique challenges: (i) due to space restrictions, only a limited number of cameras can be installed in the gymnastics stadium; and (ii) due to variations in lighting, background, uniforms, and occlusions, multi-camera gymnast detection may fail in certain views and only provide valid detections from two opposing views. These factors complicate the accurate determination of a gymnast's 3D trajectory using conventional multi-camera triangulation. To alleviate this issue, we incorporate gymnastics domain knowledge into our tracking solution. Given that a gymnast's 3D center typically lies within a predefined vertical plane during \revised{much of their} performance, we can apply a ray-plane intersection to generate coplanar 3D trajectory candidates for opposing-view detections. More specifically, we propose a novel cascaded data association (DA) paradigm that employs triangulation to generate 3D trajectory candidates when cross-view detections are sufficient, and resort to the ray-plane intersection when they are insufficient. Consequently, coplanar candidates are used to compensate for uncertain trajectories, thereby minimizing tracking failures. The robustness of our method is validated through extensive experimentation, demonstrating its superiority over existing methods in challenging scenarios. Furthermore, our gymnastics judging system, equipped with this tracking method, has been successfully applied to recent Gymnastics World Championships, earning significant recognition from the International Gymnastics Federation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。