用激光雷达监督雷达,实现恶劣天气下的高精度4D占位感知。
4D-ROLLS: 4D Radar Occupancy Learning via LiDAR Supervision
- 用激光雷达点云生成伪标签,分阶段监督雷达占位模型。
- 在雨雪雾等恶劣环境下仍保持高精度,跨数据集训练效果好。
- 轻量模型支持30Hz高速推理,可直接用于分割与预测任务。
自动驾驶需要对三维场景有全面理解,其中占位估计通过提供可行驶与占用空间的通用表示而至关重要。然而,现有方法多依赖激光雷达或摄像头,在烟雾、雨雪、雾等恶劣环境下的表现较差。本文提出4D-ROLLS,首个利用激光雷达点云作为监督信号的弱监督4D雷达占位估计方法。我们设计了一种生成伪激光雷达标签的方法,包括占位查询和激光雷达高度图,作为多阶段监督信号来训练4D雷达占位模型,并使其与激光雷达生成的占位图对齐,从而提升估计精度。大量对比实验验证了4D-ROLLS的优异性能,其在恶劣环境下的鲁棒性和跨数据集训练的有效性得到定性证明。该模型还可无缝迁移到后端任务如鸟瞰图分割和点云占位预测,展现出广泛的应用潜力。轻量网络使模型在4060显卡上实现约30Hz的快速推理。代码将公开于https://github.com/CLASS-Lab/4D-ROLLS。
原文摘要 · Abstract (English)
A comprehensive understanding of 3D scenes is essential for autonomous vehicles (AVs), and among various perception tasks, occupancy estimation plays a central role by providing a general representation of drivable and occupied space. However, most existing occupancy estimation methods rely on LiDAR or cameras, which perform poorly in degraded environments such as smoke, rain, snow, and fog. In this paper, we propose 4D-ROLLS, the first weakly supervised occupancy estimation method for 4D radar using the LiDAR point cloud as the supervisory signal. Specifically, we introduce a method for generating pseudo-LiDAR labels, including occupancy queries and LiDAR height maps, as multi-stage supervision to train the 4D radar occupancy estimation model. Then the model is aligned with the occupancy map produced by LiDAR, fine-tuning its accuracy in occupancy estimation. Extensive comparative experiments validate the exceptional performance of 4D-ROLLS. Its robustness in degraded environments and effectiveness in cross-dataset training are qualitatively demonstrated. The model is also seamlessly transferred to downstream tasks BEV segmentation and point cloud occupancy prediction, highlighting its potential for broader applications. The lightweight network enables 4D-ROLLS model to achieve fast inference speeds at about 30 Hz on a 4060 GPU. The code of 4D-ROLLS will be made available at https://github.com/CLASS-Lab/4D-ROLLS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。