融合激光雷达与雷达数据,提升无信号环境下的定位精度与鲁棒性。
LRFusionPR: A Polar BEV-Based LiDAR-Radar Fusion Network for Place Recognition
- 在极坐标鸟瞰图中构建双分支网络,实现激光雷达与雷达特征融合
- 跨模态注意力机制显著提升识别准确率,实测在多个数据集上优于基线
- 适用于单芯片和扫描雷达,适合自动驾驶复杂天气场景
在自动驾驶中,位置识别对于无卫星信号环境下的全局定位至关重要。激光雷达与雷达的位置识别方法日益受到关注,因为激光雷达提供精确测距,而雷达在恶劣天气下更具鲁棒性。然而,有效融合激光雷达与雷达进行位置识别仍具挑战性。雷达数据的噪声大且稀疏,限制了其进一步提升识别准确率的潜力;同时,异构雷达配置也增加了统一跨模态融合框架的开发难度。本文提出LRFusionPR,通过融合激光雷达与单芯片或扫描雷达,提升识别准确率与鲁棒性。技术上,设计了一种双分支网络,在统一的极坐标鸟瞰图(BEV)表示下融合不同模态。融合分支采用交叉注意力机制实现跨模态特征交互,其知识同时传递至仅以雷达为输入的蒸馏分支,进一步增强鲁棒性。最终,两分支的描述符拼接生成多模态全局描述符用于位置检索。在多个数据集上的大量实验表明,所提方法实现了高精度的位置识别,并在不同天气条件下保持鲁棒性。开源代码将发布于 https://github.com/QiZS-BIT/LRFusionPR。
原文摘要 · Abstract (English)
In autonomous driving, place recognition is critical for global localization in GPS-denied environments. LiDAR and radar-based place recognition methods have garnered increasing attention, as LiDAR provides precise ranging, whereas radar excels in adverse weather resilience. However, effectively leveraging LiDAR-radar fusion for place recognition remains challenging. The noisy and sparse nature of radar data limits its potential to further improve recognition accuracy. In addition, heterogeneous radar configurations complicate the development of unified cross-modality fusion frameworks. In this paper, we propose LRFusionPR, which improves recognition accuracy and robustness by fusing LiDAR with either single-chip or scanning radar. Technically, a dual-branch network is proposed to fuse different modalities within the unified polar coordinate bird's eye view (BEV) representation. In the fusion branch, cross-attention is utilized to perform cross-modality feature interactions. The knowledge from the fusion branch is simultaneously transferred to the distillation branch, which takes radar as its only input to further improve the robustness. Ultimately, the descriptors from both branches are concatenated, producing the multimodal global descriptor for place retrieval. Extensive evaluations on multiple datasets demonstrate that our LRFusionPR achieves accurate place recognition, while maintaining robustness under varying weather conditions. Our open-source code will be released at https://github.com/QiZS-BIT/LRFusionPR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。