提出雷达点云高效投影方法,提升恶劣天气下目标检测性能。
RADE-Net: Robust Attention Network for Radar-Only Object Detection in Adverse Weather
- 将4D雷达张量压缩91.9%后仍保留多普勒与仰角信息
- 在K-Radar数据集上比基线模型提升16.7%检测精度
- 轻量化设计适合车载实时系统,优于部分激光雷达方案
自动驾驶感知系统需满足高可靠性要求。光学传感器如摄像头和激光雷达在恶劣天气下表现不佳,而雷达具备穿透雾、雨、雪的能力,更具鲁棒性。由于全尺寸雷达张量数据量大,且缺乏相应数据集,现有雷达方法多依赖稀疏点云或2D投影,导致信息丢失。本文提出一种针对快速傅里叶变换后的4维范围-方位-多普勒-仰角(RADE)张量的3D投影方法,相比完整张量,单帧数据量减少91.9%,同时保留丰富的多普勒与仰角特征,显著提升训练与推理速度并降低模型复杂度。我们设计了RADE-Net,一种专为RADE张量3D投影优化的轻量级模型,其主干网络结合空间与通道注意力,有效挖掘雷达张量的低层与高层特征。解耦检测头直接在范围-方位域预测目标中心点,并从笛卡尔场景的丰富特征图中回归旋转3D边界框。在大规模K-Radar数据集上评估,模型在多种交通参与者和恶劣天气条件下,相较基线提升16.7%,较当前雷达仅模型提升6.5%。此外,在恶劣天气下性能超越多个激光雷达方法。
原文摘要 · Abstract (English)
Automotive perception systems are obligated to meet high requirements. While optical sensors such as Camera and Lidar struggle in adverse weather conditions, Radar provides a more robust perception performance, effectively penetrating fog, rain, and snow. Since full Radar tensors have large data sizes and very few datasets provide them, most Radar-based approaches work with sparse point clouds or 2D projections, which can result in information loss. Additionally, deep learning methods show potential to extract richer and more dense features from low level Radar data and therefore significantly increase the perception performance. Therefore, we propose a 3D projection method for fast-Fourier-transformed 4D Range-Azimuth-Doppler-Elevation (RADE) tensors. Our method preserves rich Doppler and Elevation features while reducing the required data size for a single frame by 91.9% compared to a full tensor, thus achieving higher training and inference speed as well as lower model complexity. We introduce RADE-Net, a lightweight model tailored to 3D projections of the RADE tensor. The backbone enables exploitation of low-level and high-level cues of Radar tensors with spatial and channel-attention. The decoupled detection heads predict object center-points directly in the Range-Azimuth domain and regress rotated 3D bounding boxes from rich feature maps in the cartesian scene. We evaluate the model on scenes with multiple different road users and under various weather conditions on the large-scale K-Radar dataset and achieve a 16.7% improvement compared to their baseline, as well as 6.5% improvement over current Radar-only models. Additionally, we outperform several Lidar approaches in scenarios with adverse weather conditions. The code is available under https://github.com/chr-is-tof/RADE-Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。