通过高斯混合强度建模多层遮挡,提升纯摄像头3D语义占据预测精度
RayOcc: Occlusion-Aware Ray Occupancy Estimation via Gaussian Mixture Intensity

- 将光线建模为多标签存在概率,用高斯混合表示多层遮挡
- 在nuScenes上达到当前基于高斯的占据方法最优的IoU和mIoU
- 适合需要精准处理复杂遮挡场景的自动驾驶感知系统
纯摄像头3D语义占据预测旨在从多视角图像中推断体素级场景语义,但因深度模糊和遮挡问题仍具挑战性。单条相机光线上可能存在多个空间分离的表面,导致占据本质上是多标签存在问题而非单深度估计任务。然而,现有方法通常每条光线只选择一个主导深度假设,难以建模复杂遮挡下的体积场景。为此,我们提出RayOcc,一种面向遮挡的光线占据框架,将光线建模重构为多标签存在预测。不预测类别化深度分布,而是估计每条光线上的非归一化高斯混合强度,并通过泊松事件公式转化为区间级占据概率,允许多个占据假设共存且不强制深度间互斥。预测的混合成分被解释为占据假设,用于初始化稀疏3D高斯原型,再经优化与光栅化实现语义占据预测。在nuScenes基准上的实验表明,RayOcc在对比的基于高斯的占据方法中达到了最先进的整体IoU和mIoU。
原文摘要 · Abstract (English)
Camera-only 3D semantic occupancy prediction aims to infer voxel-wise scene semantics from multi-view images, yet remains fundamentally challenging due to depth ambiguity and occlusion. Along a single camera ray, multiple spatially separated surfaces may coexist, making occupancy inherently a multi-label existence problem rather than a single-depth estimation task. However, most existing approaches favor a single dominant depth hypothesis per ray, limiting their ability to model volumetric scenes under complex occlusion. To address this limitation, we introduce RayOcc, an occlusion-aware ray occupancy framework that reformulates ray modeling as multi-label existence prediction. Instead of predicting a categorical depth distribution, RayOcc estimates a non-normalized Gaussian mixture intensity along each ray and converts it into interval-wise occupancy probabilities via a Poisson event formulation, allowing multiple occupied hypotheses to coexist without enforcing mutual competition across depth. The predicted mixture components are interpreted as occupancy hypotheses to initialize sparse 3D Gaussian primitives, which are refined and rasterized for semantic occupancy prediction. Experiments on the nuScenes benchmark show that RayOcc achieves state-of-the-art overall IoU and mIoU among the compared Gaussian-based occupancy methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。