提出新模型提升自动驾驶3D语义占位预测精度与效率
GraphGSOcc: Semantic-Geometric Graph Transformer with Dynamic-Static Decoupling for 3D Gaussian Splatting-based Occupancy Prediction
- 用双图注意力机制分离语义与几何特征,动态调整邻域范围
- 解耦动静态物体优化,边界模糊问题改善,mIoU达25.20%
- 适合高精度自动驾驶感知场景,内存占用降低13.7%
针对自动驾驶中的3D语义占位预测任务,现有3D高斯溅射(3DGS)方法存在三大问题:统一特征聚合忽略类别间语义关联、MLP迭代优化缺乏几何约束导致边界模糊、动/静态物体耦合优化存在偏差。本文提出GraphGSOcc模型,融合语义与几何图Transformer,并解耦动/静态物体优化。设计双重高斯图注意力机制:几何图基于高斯姿态自适应计算KNN搜索半径,大尺度高斯扩展邻域聚合,小尺度高斯保持局部一致性;语义图通过余弦相似度保留前M个高相关节点,显式编码实例内与跨实例语义关系。结合多尺度图注意力,底层细粒度关注边界细节,高层粗粒度建模对象拓扑结构。进一步利用语义概率分布解耦动静态物体,设计动态-静态解耦高斯注意力机制。在SurroundOcc-nuScenes、Occ3D-nuScenes、OpenOcc和KITTI等占位基准上达到当前最优性能。SurroundOcc实验中mIoU达25.20%,显存降至6.8GB,相比GaussianWorld提升1.97% mIoU,内存减少13.7%。
原文摘要 · Abstract (English)
Addressing the task of 3D semantic occupancy prediction for autonomous driving, we tackle two key issues in existing 3D Gaussian Splatting (3DGS) methods: (1) unified feature aggregation neglecting semantic correlations among similar categories and across regions, (2) boundary ambiguities caused by the lack of geometric constraints in MLP iterative optimization and (3) biased issues in dynamic-static object coupling optimization. We propose the GraphGSOcc model, a novel framework that combines semantic and geometric graph Transformer and decouples dynamic-static objects optimization for 3D Gaussian Splatting-based Occupancy Prediction. We propose the Dual Gaussians Graph Attenntion, which dynamically constructs dual graph structures: a geometric graph adaptively calculating KNN search radii based on Gaussian poses, enabling large-scale Gaussians to aggregate features from broader neighborhoods while compact Gaussians focus on local geometric consistency; a semantic graph retaining top-M highly correlated nodes via cosine similarity to explicitly encode semantic relationships within and across instances. Coupled with the Multi-scale Graph Attention framework, fine-grained attention at lower layers optimizes boundary details, while coarsegrained attention at higher layers models object-level topology. On the other hand, we decouple dynamic and static objects by leveraging semantic probability distributions and design a Dynamic-Static Decoupled Gaussian Attention mechanism to optimize the prediction performance for both dynamic objects and static scenes. GraphGSOcc achieves state-ofthe-art performance on the SurroundOcc-nuScenes, Occ3D-nuScenes, OpenOcc and KITTI occupancy benchmarks. Experiments on the SurroundOcc dataset achieve an mIoU of 25.20%, reducing GPU memory to 6.8 GB, demonstrating a 1.97% mIoU improvement and 13.7% memory reduction compared to GaussianWorld.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。