用知识蒸馏让雷达在雨天也能精准定位
4DRaL: Bridging 4D Radar with LiDAR for Place Recognition using Knowledge Distillation
- 用激光雷达模型做老师,教雷达模型识别位置
- 三模块提升雷达点云稀疏性与特征区分度
- 雨雪天仍保持领先,适合恶劣环境机器人使用
位置识别对机器人回环检测和全局定位至关重要。尽管主流算法依赖相机和激光雷达,但这些传感器易受恶劣天气影响。近期发展的4D毫米波雷达为全天候位置识别提供了新可能。然而,4D雷达数据固有的噪声和稀疏性严重制约其性能。为此,本文提出新型框架4DRaL,通过知识蒸馏(KD)提升4D雷达的位置识别能力。核心思想是采用高性能的激光雷达到激光雷达(L2L)模型作为教师,指导4D雷达到4D雷达(R2R)模型的训练。4DRaL包含三个关键KD模块:局部图像增强模块用于缓解原始4D雷达点云的稀疏性;特征分布蒸馏模块确保学生模型生成更具区分性的特征;响应蒸馏模块保持教师与学生模型在特征空间的一致性。更重要的是,通过不同模块配置,4DRaL也可用于4D雷达到激光雷达(R2L)位置识别。实验表明,无论正常或恶劣天气,4DRaL在R2R和R2L任务上均达到当前最优性能。
原文摘要 · Abstract (English)
Place recognition is crucial for loop closure detection and global localization in robotics. Although mainstream algorithms typically rely on cameras and LiDAR, these sensors are susceptible to adverse weather conditions. Fortunately, the recently developed 4D millimeter-wave radar (4D radar) offers a promising solution for all-weather place recognition. However, the inherent noise and sparsity in 4D radar data significantly limit its performance. Thus, in this paper, we propose a novel framework called 4DRaL that leverages knowledge distillation (KD) to enhance the place recognition performance of 4D radar. Its core is to adopt a high-performance LiDAR-to-LiDAR (L2L) place recognition model as a teacher to guide the training of a 4D radar-to-4D radar (R2R) place recognition model. 4DRaL comprises three key KD modules: a local image enhancement module to handle the sparsity of raw 4D radar points, a feature distribution distillation module that ensures the student model generates more discriminative features, and a response distillation module to maintain consistency in feature space between the teacher and student models. More importantly, 4DRaL can also be trained for 4D radar-to-LiDAR (R2L) place recognition through different module configurations. Experimental results prove that 4DRaL achieves state-of-the-art performance in both R2R and R2L tasks regardless of normal or adverse weather.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。