统一框架应对多传感器配置,实现跨模态定位鲁棒性提升
UniMPR: A Unified Framework for Multimodal Place Recognition with Heterogeneous Sensor Configurations
- 构建极坐标鸟瞰特征空间统一异构传感器输入
- 在7个数据集上达领先性能,支持任意模态组合
- 适合自动驾驶与机器人在复杂环境中的定位应用
位置识别是自动驾驶与机器人在无GPS环境下实现全局定位的关键。近年来,多模态位置识别(MPR)因其能融合不同模态的互补优势而受到关注。然而,现有方法仍面临三大挑战:(1)在统一框架内动态适应多种模态输入;(2)在模态缺失或退化时保持鲁棒性;(3)泛化至多样化的传感器配置。本文提出UniMPR,一种统一的多模态位置识别框架。仅用一个训练模型即可无缝适配相机、激光雷达、雷达等常见感知模态的任意组合。为解决数据异构问题,所有输入被统一映射至极坐标鸟瞰(polar BEV)特征空间,随后输入多分支网络以挖掘各模态内部及跨模态的判别特征。为充分发挥网络泛化能力与鲁棒性,我们从多个数据集构建大规模训练集,并引入自适应标签分配策略进行充分预训练。在七个数据集上的实验表明,UniMPR在不同传感器配置、模态组合和环境条件下均达到当前最优性能。代码将开源于https://github.com/QiZS-BIT/UniMPR。
原文摘要 · Abstract (English)
Place recognition is a critical component of autonomous vehicles and robotics, enabling global localization in GPS-denied environments. Recent advances have spurred significant interest in multimodal place recognition (MPR), which leverages complementary strengths of multiple modalities. Despite its potential, most existing MPR methods still face three key challenges: (1) dynamically adapting to various modality inputs within a unified framework, (2) maintaining robustness with missing or degraded modalities, and (3) generalizing across diverse sensor configurations and setups. In this paper, we propose UniMPR, a unified framework for multimodal place recognition. Using only one trained model, it can seamlessly adapt to any combination of common perceptual modalities (e.g., camera, LiDAR, radar). To tackle the data heterogeneity, we unify all inputs within a polar BEV feature space. Subsequently, the polar BEVs are fed into a multi-branch network to exploit discriminative intra-model and inter-modal features from any modality combinations. To fully exploit the network's generalization capability and robustness, we construct a large-scale training set from multiple datasets and introduce an adaptive label assignment strategy for extensive pre-training. Experiments on seven datasets demonstrate that UniMPR achieves state-of-the-art performance under varying sensor configurations, modality combinations, and environmental conditions. Our code will be released at https://github.com/QiZS-BIT/UniMPR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。