arXiv:2508.15299cs.CV2025-08中稿 · MMSports

首个融合激光雷达与摄像头的篮球追踪数据集,提升复杂场景下实时3D追踪精度。

BasketLiDAR: The First LiDAR-Camera Multimodal Dataset for Professional Basketball MOT

  • 用激光雷达+摄像头同步采集真实篮球比赛数据,实现高精度3D定位
  • 在4,445帧、3,105个球员标识上验证,大幅降低遮挡影响
  • 适合体育分析、智能裁判系统研发者使用

体育赛事中实时3D球员轨迹追踪对战术分析、表现评估和观赛体验至关重要。传统系统依赖多摄像机,受限于视频数据的二维特性及复杂的三维重建过程,难以实现实时分析。篮球场景尤为困难:十名球员在狭小场地内高速移动,频繁因身体接触导致遮挡。本文构建了首个体育目标追踪领域的多模态数据集BasketLiDAR,整合专业篮球环境中三台激光雷达与三路多视角摄像头的同步数据,并提出一种新型多目标追踪框架,显著提升追踪精度并降低计算成本。该数据集包含4,445帧图像和3,105个球员身份标注,三组传感器间身份完全同步。数据涵盖5人对5人与3人对3人实战比赛,提供完整3D位置信息与身份标注。基于此,我们开发了一种利用激光雷达高精度3D空间信息的新算法,包含纯激光雷达实时追踪流与融合激光雷达与相机数据的多模态追踪流。实验表明,该方法可实现实时运行,优于传统仅摄像头方案,尤其在遮挡条件下表现更优。数据集可通过https://sites.google.com/keio.jp/keio-csg/projects/basket-lidar申请获取。

原文摘要 · Abstract (English)

Real-time 3D trajectory player tracking in sports plays a crucial role in tactical analysis, performance evaluation, and enhancing spectator experience. Traditional systems rely on multi-camera setups, but are constrained by the inherently two-dimensional nature of video data and the need for complex 3D reconstruction processing, making real-time analysis challenging. Basketball, in particular, represents one of the most difficult scenarios in the MOT field, as ten players move rapidly and complexly within a confined court space, with frequent occlusions caused by intense physical contact. To address these challenges, this paper constructs BasketLiDAR, the first multimodal dataset in the sports MOT field that combines LiDAR point clouds with synchronized multi-view camera footage in a professional basketball environment, and proposes a novel MOT framework that simultaneously achieves improved tracking accuracy and reduced computational cost. The BasketLiDAR dataset contains a total of 4,445 frames and 3,105 player IDs, with fully synchronized IDs between three LiDAR sensors and three multi-view cameras. We recorded 5-on-5 and 3-on-3 game data from actual professional basketball players, providing complete 3D positional information and ID annotations for each player. Based on this dataset, we developed a novel MOT algorithm that leverages LiDAR's high-precision 3D spatial information. The proposed method consists of a real-time tracking pipeline using LiDAR alone and a multimodal tracking pipeline that fuses LiDAR and camera data. Experimental results demonstrate that our approach achieves real-time operation, which was difficult with conventional camera-only methods, while achieving superior tracking performance even under occlusion conditions. The dataset is available upon request at: https://sites.google.com/keio.jp/keio-csg/projects/basket-lidar

多模态追踪激光雷达篮球分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。