用激光雷达生成4维雷达数据,提升自动驾驶感知模型泛化能力。
L2RDaS: Synthesizing 4D Radar Tensors for Model Generalization via Dataset Expansion
- 从已有激光雷达数据出发,生成包含空间信息的4维雷达张量。
- 在3个检测模型上平均提升4.25% BEV精度和2.87% 3D精度。
- 支持标注对象注入,适合需要增强数据多样性的研究者。
4维(4D)雷达在自动驾驶感知任务中日益普及,因其在恶劣天气下的鲁棒性。为更好利用4D雷达数据固有的空间信息,近期深度学习方法已从稀疏点云转向使用4D雷达张量。然而,公开的4D雷达张量数据集稀缺,限制了模型在多样化驾驶场景中的泛化能力。以往方法虽尝试合成雷达数据,但未能充分挖掘4D雷达的空间特性。为此,本文提出LiDAR-to-4D雷达数据合成(L2RDaS)框架,利用现有自动驾驶数据集中的激光雷达数据生成具有空间信息的4D雷达张量。L2RDaS结合改进的U-Net架构以捕捉空间特征,并引入物体信息补充(OBIS)模块提升反射保真度。该框架无需额外传感器部署即可生成多样化驾驶场景下的雷达张量。通过扩展真实数据集,显著提升模型泛化能力,在三个检测模型上平均实现4.25%的$AP_{BEV}$和2.87%的$AP_{3D}$提升。此外,支持通过嵌入标注对象进行真值增强(GT-Aug),使$AP_{BEV}$和$AP_{3D}$进一步平均提升3.75%和4.03%。代码将开源于https://github.com/kaist-avelab/K-Radar。
原文摘要 · Abstract (English)
4-dimensional (4D) radar is increasingly adopted in autonomous driving for perception tasks, owing to its robustness under adverse weather conditions. To better utilize the spatial information inherent in 4D radar data, recent deep learning methods have transitioned from using sparse point cloud to 4D radar tensors. However, the scarcity of publicly available 4D radar tensor datasets limits model generalization across diverse driving scenarios. Previous methods addressed this by synthesizing radar data, but the outputs did not fully exploit the spatial information characteristic of 4D radar. To overcome these limitations, we propose LiDAR-to-4D radar data synthesis (L2RDaS), a framework that synthesizes spatially informative 4D radar tensors from LiDAR data available in existing autonomous driving datasets. L2RDaS integrates a modified U-Net architecture to effectively capture spatial information and an object information supplement (OBIS) module to enhance reflection fidelity. This framework enables the synthesis of radar tensors across diverse driving scenarios without additional sensor deployment or data collection. L2RDaS improves model generalization by expanding real datasets with synthetic radar tensors, achieving an average increase of 4.25\% in ${{AP}_{BEV}}$ and 2.87\% in ${{AP}_{3D}}$ across three detection models. Additionally, L2RDaS supports ground-truth augmentation (GT-Aug) by embedding annotated objects into LiDAR data and synthesizing them into radar tensors, resulting in further average increases of 3.75\% in ${{AP}_{BEV}}$ and 4.03\% in ${{AP}_{3D}}$. The implementation will be available at https://github.com/kaist-avelab/K-Radar.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。