arXiv:2602.23172cs.CVcs.AI2026-02中稿 · ICRA被引 2

用稀疏高斯点建模动态场景,实现4D全景占据追踪

Latent Gaussian Splatting for 4D Panoptic Occupancy Tracking

  • 将3D特征表示为可动的高斯点,实现空间连续特征聚合
  • 在Occ3D nuScenes和Waymo数据集上达最新性能
  • 适合需要精准动态物体识别与轨迹追踪的研究者

捕捉4D时空场景结构对机器人在动态环境中的安全可靠运行至关重要。现有方法通常只解决部分问题:要么仅提供基于边界框的粗略几何追踪,要么提供缺乏显式时间关联和实例级推理的详细3D占据估计。本文提出潜空间高斯点渲染(LaGS)用于4D全景占据追踪(4D-POT)。我们重新思考底层表示,将3D特征建模为一组稀疏的带特征高斯点。这些点作为动态、体积导向的关键点,在拼贴到体素网格解码前,实现多视角特征的空间连续、距离加权聚合。这种以点为中心的范式支持灵活的数据依赖感受野和长程空间交互,这是局部密集体素操作难以捕捉的。分层高斯表示进一步通过结合粗粒度超点的全局上下文与高分辨率流的细粒度细节,实现多尺度推理。在Occ3D nuScenes和Waymo上的大量实验表明,该方法在4D-POT任务中达到最先进性能。代码与模型已公开于https://lags.cs.uni-freiburg.de/。

原文摘要 · Abstract (English)

Capturing 4D spatiotemporal scene structure is crucial for the safe and reliable operation of robots in dynamic environments. However, existing approaches typically address only part of the problem: they either provide coarse geometric tracking via bounding boxes or detailed 3D occupancy estimates that lack explicit temporal association and instance-level reasoning. In this work, we present Latent Gaussian Splatting (LaGS) for 4D Panoptic Occupancy Tracking (4D-POT). We revisit the underlying representation and model 3D features as a sparse set of feature-bearing Gaussians. These act as dynamic, volume-oriented keypoints that enable spatially continuous, distance-weighted aggregation of multi-view features before being splatted into a voxel grid for decoding. This point-centric formulation enables flexible, data-dependent receptive fields and long-range spatial interactions that are difficult to capture with local and dense voxel-based operators. A hierarchical Gaussian representation further enables multi-scale reasoning by combining global context from coarse super-points with fine-grained detail from higher-resolution streams. Extensive experiments on Occ3D nuScenes and Waymo demonstrate state-of-the-art performance for 4D-POT. We provide code and models at https://lags.cs.uni-freiburg.de/.

4D重建占据估计高斯点云动态追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。