提出BroadTrack系统,实现足球直播摄像机高精度实时追踪。
BroadTrack: Broadcast Camera Tracking for Soccer
- 结合球场标记检测与自定义相机/三脚架模型进行精准定位
- 在SoccerNet数据集上重投影误差减半,指标提升超15%
- 专为体育场高空三脚架摄像机设计,适合体育直播场景
相机标定与定位技术广泛应用于足球广播,支持比赛分析、增强现实图形插入等。现有方法多依赖单视角标定,利用广角画面中普遍存在的球场标记,但对时间序列建模不足,通常采用通用追踪或滤波技术处理时序信息。少数研究尝试引入领域知识,但仍缺乏高性能、即插即用的足球直播摄像机追踪系统,尤其针对体育场四周的高空三脚架摄像机。本文提出BroadTrack系统,通过结合开源球场检测器与精心设计的相机及三脚架模型,实现了高效、鲁棒、准确的追踪。在SoccerNet数据集上,该系统将平均重投影误差降低50%,Jaccard指数提升超过15%。此外,尽管SoccerNet视频较短(30秒),我们还展示了20分钟直播片段的定性结果,验证了系统的鲁棒性与实用性。
原文摘要 · Abstract (English)
Camera calibration and localization, sometimes simply named camera calibration, enables many applications in the context of soccer broadcasting, for instance regarding the interpretation and analysis of the game, or the insertion of augmented reality graphics for storytelling or refereeing purposes. To contribute to such applications, the research community has typically focused on single-view calibration methods, leveraging the near-omnipresence of soccer field markings in wide-angle broadcast views, but leaving all temporal aspects, if considered at all, to general-purpose tracking or filtering techniques. Only a few contributions have been made to leverage any domain-specific knowledge for this tracking task, and, as a result, there lacks a truly performant and off-the-shelf camera tracking system tailored for soccer broadcasting, specifically for elevated tripod-mounted cameras around the stadium. In this work, we present such a system capable of addressing the task of soccer broadcast camera tracking efficiently, robustly, and accurately, outperforming by far the most precise methods of the state-of-the-art. By combining the available open-source soccer field detectors with carefully designed camera and tripod models, our tracking system, BroadTrack, halves the mean reprojection error rate and gains more than 15% in terms of Jaccard index for camera calibration on the SoccerNet dataset. Furthermore, as the SoccerNet dataset videos are relatively short (30 seconds), we also present qualitative results on a 20-minute broadcast clip to showcase the robustness and the soundness of our system.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。