arXiv:2603.08521cs.CVcs.RO2026-03中稿 · IEEE/RSJ IROS 2026被引 1

构建首个全景鱼眼相机4D语义占位跟踪基准,提升动态环境感知精度。

OccTrack360: 4D Panoptic Occupancy Tracking from Surround-View Fisheye Cameras

  • 提出FoSOcc框架,通过聚焦球面与鱼眼投影增强定位精度
  • 在174~2234帧长序列上实现几何规则类物体显著性能提升
  • 适合自动驾驶与机器人环境建模研究者参考

以空间连续且时间一致的方式理解动态三维环境是机器人与自动驾驶的基础。尽管近期占据预测技术提供了场景几何与语义的统一表示,但4D全景占据跟踪仍受限于缺乏支持全景鱼眼感知、长时序序列和实例级体素追踪的基准数据集。为此,我们提出OccTrack360,一个面向全景鱼眼相机的4D全景占据跟踪新基准。该数据集提供比以往更长且多样的序列(174~2234帧),并包含精心设计的体素可见性标注,包括全向遮挡掩码与基于MEI的鱼眼视场掩码。为建立强健的鱼眼导向基线,我们进一步提出聚焦球面占据(FoSOcc)框架,解决鱼眼占据跟踪中的两大挑战:球面畸变投影与体素空间定位不准。FoSOcc包含中心聚焦模块(CFM)以通过监督聚焦引导增强实例感知的空间定位,以及基于鱼眼增强的提升模块(FEL),在统一投影模型下将透视提升扩展至鱼眼成像。在Occ3D-Waymo与OccTrack360上的大量实验表明,所提方法在几何规则类别上显著提升占据跟踪质量,并为未来全景鱼眼4D占据跟踪研究奠定坚实基线。基准与源代码将公开于https://github.com/YouthZest-Lin/OccTrack360。

原文摘要 · Abstract (English)

Understanding dynamic 3D environments in a spatially continuous and temporally consistent manner is fundamental for robotics and autonomous driving. While recent advances in occupancy prediction provide a unified representation of scene geometry and semantics, progress in 4D panoptic occupancy tracking remains limited by the lack of benchmarks that support surround-view fisheye sensing, long temporal sequences, and instance-level voxel tracking. To address this gap, we present OccTrack360, a new benchmark for 4D panoptic occupancy tracking from surround-view fisheye cameras. OccTrack360 provides substantially longer and more diverse sequences (174~2234 frames) than prior benchmarks, together with principled voxel visibility annotations, including an all-direction occlusion mask and an MEI-based fisheye field-of-view mask. To establish a strong fisheye-oriented baseline, we further propose Focus on Sphere Occ (FoSOcc), a framework that addresses two core challenges in fisheye occupancy tracking: distorted spherical projection and inaccurate voxel-space localization. FoSOcc includes a Center Focusing Module (CFM) to enhance instance-aware spatial localization through supervised focus guidance, and a Fisheye-based Enhanced Lifting (FEL) that extends perspective lifting to fisheye imaging under the Unified Projection Model. Extensive experiments on Occ3D-Waymo and OccTrack360 show that our method improves occupancy tracking quality with notable gains on geometrically regular categories, and establishes a strong baseline for future research on surround-view fisheye 4D occupancy tracking. The benchmark and source code will be made publicly available at https://github.com/YouthZest-Lin/OccTrack360.

4D占据鱼眼相机自动驾驶轨迹追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。