提出RIM框架,实现无人机跨域全局视觉定位的高效高精度匹配。
RIM: A Retrieval-In-Matching Framework for Cross-Domain Global Visual Localization of UAVs

- 用谷歌3D瓦片采样多视角参考图,结合正负样本微调增强跨域适应性。
- 在EPFL和长安公园数据集上,召回率提升4.45~13.77个百分点,端到端耗时仅67.9毫秒。
- 冻结主干模型复用特征,融合浅层网络实现检索与描述一体化,适合边缘部署。
使用遥感参考地图进行无人机全局视觉定位受到广泛关注。然而,无人机影像与参考图像在拍摄时间及成像平台上的差异导致显著的跨域外观和视点偏移,给六自由度(6-DoF)位姿估计带来挑战。本文通过在不同位置、高度和朝向下从Google 3D Tiles中采样无人机视角参考图来缓解此问题。采用两阶段跨域微调策略,利用姿态相近的正样本和地理上遥远的难负样本训练SALAD;同时引入局部几何一致性对前K个候选进行重排序。进一步提出检索-匹配框架RIM,冻结已适配的DINOv2-B检索器,并蒸馏一个局部描述符解码器,复用其令牌场并融合浅层VGG19细节流。一次DINOv2-B前向传播即可完成SALAD检索与局部描述,避免了第二骨干网络,同时保留检索特征。我们在重建的EPFL Urbanscape和自采集的长安公园数据集上零样本评估RIM,两者均与训练数据地理上不重叠。RIM超越十类近期检索基线。在25/50米全3D距离度量下,相比SALAD,EPFL上召回率@1提升8.55/13.77个百分点,长安公园上提升4.45/8.94个百分点。在Top-K=5时,包含检索、候选匹配和鲁棒几何验证的完整定位查询端到端耗时仅67.9毫秒:比最强的独立稀疏匹配基线快1.8倍,比RoMa快40倍以上,且重排序精度相当。结果证明该方案在无GNSS环境下具备高效可部署性。
原文摘要 · Abstract (English)
Global visual localization of unmanned aerial vehicles (UAVs) using remote-sensing reference maps has attracted increasing attention. However, acquisition-time and imaging-platform differences between UAV and reference imagery induce substantial cross-domain appearance and viewpoint shifts, challenging robust six-degree-of-freedom (6-DoF) pose estimation. We address these shifts by sampling UAV-viewpoint reference views from Google 3D Tiles across locations, altitudes, and orientations. A two-stage cross-domain fine-tuning recipe adapts SALAD using pose-near positives and geographically distant hard negatives, while local geometric consistency re-ranks the Top-K candidates. We further propose Retrieval-In-Matching (RIM), which freezes the adapted DINOv2-B retriever and distils a local-descriptor decoder that reuses its token field alongside a shallow VGG19 detail stream. One query-side DINOv2-B forward thus serves both SALAD retrieval and local description, eliminating a second foundation-model backbone while preserving retrieval descriptors by construction. We evaluate RIM zero-shot on the reconstructed EPFL Urbanscape and self-collected Chang'an Park datasets, both geographically disjoint from the training data. RIM outperforms ten recent retrieval baseline families. At 25/50 m under the full 3D distance metric, it improves Recall@1 over SALAD by 8.55/13.77 percentage points on EPFL and 4.45/8.94 points on Park. At Top-K=5, the complete measured localization query, including retrieval, candidate matching, and robust geometric verification, takes 67.9 ms end-to-end: 1.8 times faster than the strongest separate sparse-matching baseline and over 40 times faster than RoMa, while achieving comparable re-ranking accuracy. These results establish an efficient and deployable pipeline for UAV global visual localization in GNSS-challenged environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。