arXiv:2504.13596cs.CVcs.RO2025-04中稿 · ICRA被引 1

用全局先验提升局部3D占位预测,支持多车协同建图

Collaborative Learning of Local 3D Occupancy Prediction and Versatile Global Occupancy Mapping

  • 通过当前与全局先验特征自适应融合,增强局部感知
  • 在Occ3D-nuScenes上达到领先性能,静态语义类别显著提升
  • 支持多车协同更新大场景地图,适用于开放词汇3D建图

基于视觉的3D语义占位预测对自动驾驶至关重要,可统一建模静态基础设施与动态物体。全局占位地图作为长期记忆先验,在遮挡或光照不良等挑战性场景中提供历史上下文,弥补当前观测不足。本文提出长时记忆先验占位(LMPOcc)框架,通过插件式设计将全局先验融入局部预测,并利用新观测持续更新全局地图。为实现先验信息增益,设计轻量高效的当前-先验融合模块,自适应整合先验与当前特征;同时引入模型无关的先验格式,确保跨不同预测基线的兼容性与持续更新能力。LMPOcc在Occ3D-nuScenes基准上取得当前最优局部占位预测性能,尤其在静态语义类别上表现突出。进一步验证了其通过多车众包构建大规模全局占位地图的能力,并利用生成的稠密深度支持3D开放词汇地图构建。本方法开创了连续全局信息更新与存储的新范式,为大型室外环境的全面、可扩展场景理解铺平道路。

原文摘要 · Abstract (English)

Vision-based 3D semantic occupancy prediction is vital for autonomous driving, enabling unified modeling of static infrastructure and dynamic agents. Global occupancy maps serve as long-term memory priors, providing valuable historical context that enhances local perception. This is particularly important in challenging scenarios such as occlusion or poor illumination, where current and nearby observations may be unreliable or incomplete. Priors aggregated from previous traversals under better conditions help fill gaps and enhance the robustness of local 3D occupancy prediction. In this paper, we propose Long-term Memory Prior Occupancy (LMPOcc), a plug-and-play framework that incorporates global occupancy priors to boost local prediction and simultaneously updates global maps with new observations. To realize the information gain from global priors, we design an efficient and lightweight Current-Prior Fusion module that adaptively integrates prior and current features. Meanwhile, we introduce a model-agnostic prior format to enable continual updating of global occupancy and ensure compatibility across diverse prediction baselines. LMPOcc achieves state-of-the-art local occupancy prediction performance validated on the Occ3D-nuScenes benchmark, especially on static semantic categories. Furthermore, we verify LMPOcc's capability to build large-scale global occupancy maps through multi-vehicle crowdsourcing, and utilize occupancy-derived dense depth to support the construction of 3D open-vocabulary maps. Our method opens up a new paradigm for continuous global information updating and storage, paving the way towards more comprehensive and scalable scene understanding in large outdoor environments.

3D占位自动驾驶多车协同先验建图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。