用高斯点云融合摄像头与雷达数据,提升自动驾驶感知效率。
GaussianCaR: Gaussian Splatting for Efficient Camera-Radar Fusion
- 将高斯点云重用于跨视角特征对齐,统一图像与雷达输入
- 在nuScenes上实现车辆57.3%、道路82.9%、车道线50.1%的分割精度
- 推理速度比现有方法快3.2倍,适合实时系统部署
在复杂交通场景中,动态物体与地图元素的鲁棒精准感知对自动驾驶安全导航至关重要。尽管视觉方法已成为主流,但融合雷达数据可进一步提升性能。本文提出GaussianCaR,一种基于高斯点云的端到端鸟瞰图(BEV)分割网络,通过将原始图像像素与雷达点映射至统一的BEV空间,有效弥合视差差距。该架构结合多尺度融合与Transformer解码器,高效提取特征。实验表明,在nuScenes数据集上,该方法在车辆、道路和车道线的分割任务中分别达到57.3%、82.9%和50.1%的交并比,性能媲美或超越当前最优,同时推理速度提升3.2倍。代码与项目页面已公开。
原文摘要 · Abstract (English)
Robust and accurate perception of dynamic objects and map elements is crucial for autonomous vehicles performing safe navigation in complex traffic scenarios. While vision-only methods have become the de facto standard due to their technical advances, they can benefit from effective and cost-efficient fusion with radar measurements. In this work, we advance fusion methods by repurposing Gaussian Splatting as an efficient universal view transformer that bridges the view disparity gap, mapping both image pixels and radar points into a common Bird's-Eye View (BEV) representation. Our main contribution is GaussianCaR, an end-to-end network for BEV segmentation that, unlike prior BEV fusion methods, leverages Gaussian Splatting to map raw sensor information into latent features for efficient camera-radar fusion. Our architecture combines multi-scale fusion with a transformer decoder to efficiently extract BEV features. Experimental results demonstrate that our approach achieves performance on par with, or even surpassing, the state of the art on BEV segmentation tasks (57.3%, 82.9%, and 50.1% IoU for vehicles, roads, and lane dividers) on the nuScenes dataset, while maintaining a 3.2x faster inference runtime. Code and project page are available online.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。