arXiv:2606.26780cs.CVeess.IV2026-06被引 2

用事件相机和自适应追踪系统,实时高精度测量球类旋转参数。

Event-based Gaze Control System for Accurate Real-time Spin Estimation in Professional Ball Games

论文配图:Event-based Gaze Control System for Accurate Real-time Spin Estimation in Professional Ball Games
图 1 · 摘自论文原文
  • 结合事件相机与动态镜面追踪,实现无标记球体持续定位。
  • 离线方法在静态球上误差仅1.2%(幅度)和1.5度(轴向)。
  • 在线系统实测延迟仅3毫秒,适合专业乒乓球等高速赛事应用。

旋转在众多球类运动中对轨迹有重要影响。传统摄像头因球体小、速度快、旋转剧烈,难以准确捕捉。为此,我们提出一种基于事件相机的主动视觉系统,可实时追踪未标记球体并测量其旋转。系统包含高时间分辨率事件相机、高速云台镜面以保持球体在视场内,以及低延迟可调焦远摄镜头提升空间分辨率并保持对焦。采用混合追踪策略:2D事件检测用于中心定位,3D球体定位系统用于重初始化。针对高精度旋转估计,提出离线对比度最大化方法(s-CMax),在乒乓球、棒球、网球和高尔夫球等多种静止球上达到最优性能,平均幅度误差1.2%,轴向误差1.5度。作为实时应用案例,进一步开发了面向乒乓球的低延迟在线方法,使用不确定性感知卷积神经网络,训练数据来自离线方法生成的伪真值标签,并结合GPU加速批量对比度最大化进行优化。在三视角设置下,于职业乒乓球比赛中验证,系统实现8.8%幅度误差、6.4度轴向偏差,延迟仅3毫秒,吞吐率达750 Hz。

原文摘要 · Abstract (English)

Spin plays a crucial role in many ball sports due to its effect on the trajectory of the ball. Vision-based estimation of the ball's spin during a game with conventional cameras is challenging due to the ball's small size, high speed, and fast rotation. To address these challenges, we propose an event-based active vision system that can track unmodified balls and measure their spin in real time. The system consists of an event camera for its high temporal resolution and minimal motion blur, high-speed pan/tilt galvanometer mirrors to keep the ball in the field of view, and a low-latency focus-tunable telephoto lens to increase the spatial resolution on the ball and keep it in focus. To track the ball, we use a hybrid approach that combines 2D event-based detection for centering and 3D positions from a ball localization system for re-initialization. For high-accuracy spin estimation, we propose an offline method that performs contrast maximization on the sphere (s-CMax). This method achieves state-of-the-art accuracy on static balls across multiple sports (table tennis, baseball, tennis, and golf), with mean magnitude and axis errors of 1.2% and 1.5 degrees, respectively. We then develop a low-latency online method for table tennis as a case study in real-time applications. This method uses an uncertainty-aware convolutional neural network trained on pseudo-ground-truth spin labels from the offline approach, combined with a GPU-accelerated batch implementation of contrast maximization for refinement. We demonstrate reliable tracking and spin estimation with a three-view setup during professional table tennis matches, with high accuracy (8.8% magnitude and 6.4 degrees axis mismatch w.r.t. the offline method), 3 ms latency, and 750 Hz throughput.

事件相机旋转估计实时追踪体育分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。