用道路地图做几何先验,让无人机定位更抗恶劣天气
Road Maps as Free Geometric Priors: Weather-Invariant Drone Geo-Localization with GeoFuse

- 将道路地图与卫星图融合,利用其不变的几何结构提升定位鲁棒性
- 在大学1652和DenseUAV数据集上,准确率分别提升3.46%和23.18%
- 适合做跨视角、抗天气变化的无人机地理定位研究
无人机视图地理定位旨在将受恶劣天气(如雨、雪、雾)影响的查询无人机图像,与带有地理标签的卫星图像库进行匹配。天气引起的退化(如噪声、能见度降低、部分遮挡)加剧了固有的跨视角域差异。以往方法多依赖天气特定架构或数据增强,却忽略了可免费获取的道路地图——其蕴含的强几何布局线索(如道路网络、建筑轮廓)天然不受气象影响。本文提出GeoFuse,一种跨模态融合框架,通过精确对齐的道路地图瓦片与卫星图像结合,生成更具区分性且抗天气的表征。首先,在University-1652和DenseUAV基准上补充地理对齐的道路地图,提供鲁棒的结构先验;其次,设计灵活的融合模块,通过标记级和通道级交互,结合卫星与地图特征,并引入轻量级动态门控机制,按实例自适应加权模态贡献;最后,采用类别级跨视图对比学习,促进退化无人机特征与融合后的卫星-地图表征间的稳健对齐。大量实验表明,GeoFuse在多种天气条件下均优于现有方法,在University-1652和DenseUAV上召回率@1分别提升3.46%和23.18%。
原文摘要 · Abstract (English)
Drone-view geo-localization aims to match a query drone image, often captured under adverse weather conditions (e.g., rain, snow, fog), against a gallery of geo-tagged satellite images. Weather-induced degradations in the drone view, such as noise, reduced visibility, and partial occlusions, severely exacerbate the intrinsic cross-view domain gap. While prior methods predominantly rely on weather-specific architectures or data augmentations, they have largely overlooked road map data, a readily available modality that provides strong, inherently weather-invariant geometric layout cues (e.g., road networks and building footprints) at negligible additional cost. We introduce GeoFuse, a cross-modal fusion framework that integrates precisely aligned road map tiles with satellite imagery to yield more discriminative and weather-resilient representations. We first augment the existing University-1652 and DenseUAV benchmarks with geo-aligned road maps, supplying structural priors robust to meteorological variations. Building on this, we propose a flexible fusion module that combines satellite and road map features via token-level and channel-level interactions, with a lightweight dynamic gating mechanism that adaptively weights modality contributions per instance. Finally, we employ class-level cross-view contrastive learning to promote robust alignment between weather-degraded drone features and the fused satellite-roadmap representations. Extensive experiments under diverse weather conditions show that GeoFuse consistently outperforms state-of-the-art methods, achieving +3.46% and +23.18% Recall@1 accuracy on the University-1652 and DenseUAV benchmarks, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。