用球面状态空间滤波实现全景3D多目标跟踪,精度达分米级。
S3KF: Spherical State-Space Kalman Filtering for Panoramic 3D Multi-Object Tracking
- 在单位球面上统一建模方位、尺度与深度,避免传统方法的冗余参数
- 融合全景相机与激光雷达数据,实现在动态场景下身份连续性提升
- 可在Jetson AGX Orin上实时运行,适合工业级大范围部署
全景多目标跟踪对工业安全监控、广域机器人感知及无基础设施的大空间部署至关重要。现有图像平面跟踪器受相机投影限制,在全景图像中不可靠,而传统欧氏3D方法引入冗余方向参数,难以自然统一角度、尺度与深度估计。本文提出S³KF框架,基于可旋转激光雷达与四鱼眼相机阵列,采用单位球面ℝ²上的几何一致状态表示:物体方位通过二维切平面参数化,与盒体尺度和深度动态联合估计。基于此状态,构建扩展球面卡尔曼滤波流程,融合全景相机检测与激光雷达深度观测实现多模态跟踪。进一步建立基于可穿戴定位设备与共享全局激光雷达地图的真值生成管道,无需动捕系统即可定量评估。在自采集真实序列上的实验表明,该方法达到分米级平面跟踪精度,动态场景中身份连续性优于2D全景基线,且可在Jetson AGX Orin平台实现实时运行。结果表明,该框架是全景感知与工业级多目标跟踪的实用解决方案。
原文摘要 · Abstract (English)
Panoramic multi-object tracking is important for industrial safety monitoring, wide-area robotic perception, and infrastructure-light deployment in large workspaces. In these settings, the sensing system must provide full-surround coverage, metric geometric cues, and stable target association under wide field-of-view distortion and occlusion. Existing image-plane trackers are tightly coupled to the camera projection and become unreliable in panoramic imagery, while conventional Euclidean 3D formulations introduce redundant directional parameters and do not naturally unify angular, scale, and depth estimation. In this paper, we present $\mathbf{S^3KF}$, a panoramic 3D multi-object tracking framework built on a motorized rotating LiDAR and a quad-fisheye camera rig. The key idea is a geometry-consistent state representation on the unit sphere $\mathbb{S}^2$, where object bearing is modeled by a two-degree-of-freedom tangent-plane parameterization and jointly estimated with box scale and depth dynamics. Based on this state, we derive an extended spherical Kalman filtering pipeline that fuses panoramic camera detections with LiDAR depth observations for multimodal tracking. We further establish a map-based ground-truth generation pipeline using wearable localization devices registered to a shared global LiDAR map, enabling quantitative evaluation without motion-capture infrastructure. Experiments on self-collected real-world sequences show decimeter-level planar tracking accuracy, improved identity continuity over a 2D panoramic baseline in dynamic scenes, and real-time onboard operation on a Jetson AGX Orin platform. These results indicate that the proposed framework is a practical solution for panoramic perception and industrial-scale multi-object tracking.The project page can be found at https://kafeiyin00.github.io/S3KF/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。