用雷达在激光地图中定位,雨雪天也能准
RLPR: Radar-to-LiDAR Place Recognition via Two-Stage Asymmetric Cross-Modal Alignment for Autonomous Driving
- 双流网络提取去传感器特性的结构特征
- 两阶段非对称对齐使雷达图匹配精度达新高
- 适配多种雷达类型,零样本迁移能力强
全天候自主驾驶依赖可靠定位。尽管激光雷达(LiDAR)定位广泛使用,但在恶劣天气下性能下降;而雷达虽耐受天气,却因缺乏雷达地图难以应用。为填补这一空白,本文提出雷达到激光雷达的场景识别框架RLPR,实现雷达扫描在现有激光地图中的定位。针对跨模态特征难提取、训练数据少及雷达信号差异大等挑战,设计双流网络以剥离传感器特有信号(如多普勒、反射强度),并基于雷达与激光雷达间任务特异性不对称性,提出两阶段非对称跨模态对齐(TACMA)策略,利用预训练雷达分支作为判别锚点引导对齐。在四个数据集上的实验表明,该方法在多种雷达类型(单芯片、扫描式、4D雷达)上均达到当前最优精度,并具备强零样本泛化能力。
原文摘要 · Abstract (English)
All-weather autonomy is critical for autonomous driving, which necessitates reliable localization across diverse scenarios. While LiDAR place recognition is widely deployed for this task, its performance degrades in adverse weather. Conversely, radar-based methods, though weather-resilient, are hindered by the general unavailability of radar maps. To bridge this gap, radar-to-LiDAR place recognition, which localizes radar scans within existing LiDAR maps, has garnered increasing interest. However, extracting discriminative and generalizable features shared between modalities remains challenging, compounded by the scarcity of large-scale paired training data and the signal heterogeneity across radar types. In this work, we propose RLPR, a robust radar-to-LiDAR place recognition framework compatible with single-chip, scanning, and 4D radars. We first design a dual-stream network to extract structural features that abstract away from sensor-specific signal properties (e.g., Doppler or RCS). Subsequently, motivated by our task-specific asymmetry observation between radar and LiDAR, we introduce a two-stage asymmetric cross-modal alignment (TACMA) strategy, which leverages the pre-trained radar branch as a discriminative anchor to guide the alignment process. Experiments on four datasets demonstrate that RLPR achieves state-of-the-art recognition accuracy with strong zero-shot generalization capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。