arXiv:2509.16119cs.CV2025-09中稿 · ICRA被引 2

用高斯表示提升4D雷达3D检测精度与速度,适合车载实时部署。

RadarGaussianDet3D: Gaussian Representation-based Real-time 3D Object Detection with 4D Automotive Radars

  • 用高斯原语和3D高斯点云渲染替代传统柱状编码,生成更稠密特征图。
  • 在TJ4DRadSet和View-of-Delft数据集上实现更高检测精度,推理速度显著提升。
  • 专为嵌入式设备设计,低延迟算法支持自动驾驶实时运行。

4D汽车雷达因其低成本、强鲁棒性及固有的速度测量能力,在自动驾驶中日益受到关注。然而,现有基于4D雷达的3D检测器严重依赖柱状编码器进行鸟瞰图(BEV)特征提取,每个点仅贡献于单一BEV网格,导致特征图稀疏、表征质量下降;同时,边界框属性独立优化,影响检测精度。此外,其推理速度虽在高端GPU上达标,却难以满足车载嵌入式设备的实时需求。为此,本文提出高效且有效的高斯表示3D检测器RadarGaussianDet3D,利用高斯原型与分布作为雷达点和边界框的中间表示。设计新型点高斯编码器(PGE),在特征聚合后将每点转化为高斯原语,并采用3D高斯点云渲染(3DGS)技术进行BEV栅格化,生成更稠密特征图。PGE通过优化点特征聚合算法与快速3DGS渲染,实现极低延迟。同时提出新框高斯损失(BGL),将边界框转换为3D高斯分布,通过距离度量实现更全面一致的优化。在TJ4DRadSet和View-of-Delft数据集上的大量实验表明,RadarGaussianDet3D在保持高检测精度的同时,推理速度大幅提升,具备在自动驾驶中实时部署的潜力。

原文摘要 · Abstract (English)

4D automotive radars have gained increasing attention for autonomous driving due to their low cost, robustness, and inherent velocity measurement capability. However, existing 4D radar-based 3D detectors rely heavily on pillar encoders for BEV feature extraction, where each point contributes to only a single BEV grid, resulting in sparse feature maps and degraded representation quality. In addition, they also optimize bounding box attributes independently, leading to sub-optimal detection accuracy. Moreover, their inference speed, while sufficient for high-end GPUs, may fail to meet the real-time requirement on vehicle-mounted embedded devices. To overcome these limitations, an efficient and effective Gaussian-based 3D detector, namely RadarGaussianDet3D is introduced, leveraging Gaussian primitives and distributions as intermediate representations for radar points and bounding boxes. In RadarGaussianDet3D, a novel Point Gaussian Encoder (PGE) is designed to transform each point into a Gaussian primitive after feature aggregation and employs the 3D Gaussian Splatting (3DGS) technique for BEV rasterization, yielding denser feature maps. PGE exhibits exceptionally low latency, owing to the optimized algorithm for point feature aggregation and fast rendering of 3DGS. In addition, a new Box Gaussian Loss (BGL) is proposed, which converts bounding boxes into 3D Gaussian distributions and measures their distance to enable more comprehensive and consistent optimization. Extensive experiments on TJ4DRadSet and View-of-Delft demonstrate that RadarGaussianDet3D achieves high detection accuracy while delivering substantially faster inference, highlighting its potential for real-time deployment in autonomous driving.

3D检测雷达感知高斯表示实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。