利用球场几何特征提升足球摄像机标定精度
Enhancing Soccer Camera Calibration Through Keypoint Exploitation
- 通过球场线条与圆弧交点等几何特征扩展可用标定点
- 在SoccerNet挑战赛中取得第一名,显著提升标定准确率
- 适合体育分析、球员追踪等需要精准三维重建的场景
精确的摄像机标定是将摄像头传感器的二维图像转换为三维世界坐标的关键,支持球员追踪、越位判罚和表现分析等体育分析任务。然而,传统和基于深度学习的方法都面临高质量点对数量不足的挑战。本文提出多阶段流程,利用足球场的结构特征,通过线线、线圆交点、圆上点及其他几何特征大幅增加可用于标定的有效点数。为缓解标注不完善的影响,采用数据拟合技术,并结合真实球场尺寸的几何约束。通过深度学习检测关键点和线条,再用投票算法迭代筛选最可靠的点,进一步提升标定精度。我们在目前最大的足球广播摄像机标定数据集上进行评估,在SoccerNet Camera Calibration Challenge 2023 [arXiv:2309.06006] 中获得第一名,验证了该方法在真实场景中的有效性。项目代码已公开于 https://github.com/NikolasEnt/soccernet-calibration-sportlight。
原文摘要 · Abstract (English)
Accurate camera calibration is essential for transforming 2D images from camera sensors into 3D world coordinates, enabling precise scene geometry interpretation and supporting sports analytics tasks such as player tracking, offside detection, and performance analysis. However, obtaining a sufficient number of high-quality point pairs remains a significant challenge for both traditional and deep learning-based calibration methods. This paper introduces a multi-stage pipeline that addresses this challenge by leveraging the structural features of the football pitch. Our approach significantly increases the number of usable points for calibration by exploiting line-line and line-conic intersections, points on the conics, and other geometric features. To mitigate the impact of imperfect annotations, we employ data fitting techniques. Our pipeline utilizes deep learning for keypoint and line detection and incorporates geometric constraints based on real-world pitch dimensions. A voter algorithm iteratively selects the most reliable keypoints, further enhancing calibration accuracy. We evaluated our approach on the largest football broadcast camera calibration dataset available, and secured the top position in the SoccerNet Camera Calibration Challenge 2023 [arXiv:2309.06006], which demonstrates the effectiveness of our method in real-world scenarios. The project code is available at https://github.com/NikolasEnt/soccernet-calibration-sportlight .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。