arXiv:2608.11263cs.CV2026-08

提出统一几何一致框架,实现视觉与激光雷达跨模态定位的高精度匹配。

GeoUniPR: A Geometry-Consistent Unified Framework for Cross-Modal Place Recognition

论文配图:GeoUniPR: A Geometry-Consistent Unified Framework for Cross-Modal Place Recognition
图 1 · 摘自论文原文
  • 将点云投影至相机视角生成几何一致深度图,建立视觉与激光雷达直接对应关系。
  • 在KITTI和KITTI-360上达到当前最优性能,跨数据集泛化能力强。
  • 无需复杂对齐模块或全量微调,参数高效适配,适合实际部署场景。

跨模态位置识别(CMPR)旨在识别不同传感模态(如视觉与激光雷达)下的同一地点。现有方法通常依赖复杂的对齐模块、多阶段训练或预训练主干的全量微调来弥合模态差异。本文从几何一致性角度重新审视CMPR,提出GeoUniPR——一种统一且简洁的几何一致框架。该框架通过将激光雷达点云投影到相机视角,构建几何一致的深度图像视图(DIV),建立RGB与LiDAR之间的直接对应关系。进一步,通过融合强度和表面法线等原生激光雷达特征,形成多通道几何表示,增强结构一致性。基于此表示,采用两组架构相同的视觉变压器(ViT)编码器学习统一嵌入空间,通过参数高效适配进行训练,无需辅助对齐模块、多阶段训练或全主干微调。此外,提出面向CMPR的时空一致InfoNCE(SC-InfoNCE)损失函数,在保持空间连续性下抑制距离导致的误负例。在KITTI与KITTI-360上的大量实验表明,GeoUniPR在同模态与跨模态位置识别上均达到当前最优(SOTA)性能,并具备强大的跨数据集泛化能力。

原文摘要 · Abstract (English)

Cross-modal place recognition (CMPR) aims to identify the same location across heterogeneous sensing modalities, such as vision and LiDAR. Existing methods commonly bridge the modality gap using complex alignment modules, multi-stage training, or full fine-tuning of pretrained backbones. In this work, we revisit CMPR from the perspective of geometric consistency and propose GeoUniPR, a unified and concise geometry-consistent framework. GeoUniPR reduces cross-modal discrepancy at the representation level by projecting LiDAR point clouds into the camera perspective to construct Geometry-Consistent depth image views (DIV), which establish direct RGB-LiDAR correspondence. We further augment DIV with native LiDAR cues, including intensity and surface-normal information, yielding a multi-channel geometric representation that improves structural consistency. Based on this representation, GeoUniPR learns a unified embedding space using two modality-specific ViT-based encoders with identical architectures, trained through parameter-efficient adaptation without auxiliary alignment modules, multi-stage training, or full backbone fine-tuning. In addition, we introduce Spatially-Consistent InfoNCE (SC-InfoNCE), a CMPR-specific contrastive objective that suppresses distance-induced false negatives under spatial continuity. Extensive experiments on KITTI and KITTI-360 demonstrate that GeoUniPR achieves state-of-the-art (SOTA) performance in both same-modal and cross-modal place recognition, with strong cross-dataset generalization.

跨模态识别几何一致性激光雷达视觉定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。