解决无人机导航中俯视图与卫星图的几何错位问题
(MGS)$^2$-Net: Unifying Micro-Geometric Scale and Macro-Geometric Structure for Cross-View Geo-Localization
- 分离宏观结构与微观尺度,分别用滤波和动态校正增强匹配
- 在两个数据集上达到97.5%和97.02%的召回率,领先现有方法
- 适合需要高精度跨视角定位的无人机、自动驾驶场景
跨视角地理定位(CVGL)对无卫星信号环境下的无人机导航至关重要,但俯视航空图像与正射卫星参考之间存在剧烈几何错位。现有方法多局限于二维流形,忽略三维几何中视图相关的垂直立面(宏观结构)和尺度变化(微观尺度)对特征对齐的严重干扰。为此,本文提出 (MGS)² 框架,核心为宏观几何结构过滤(MGSF)模块:通过膨胀几何梯度物理剔除高频立面噪声,增强视角不变的水平面。为保障结构过滤输入鲁棒性,引入微观几何尺度自适应(MGSA)模块,利用深度先验通过多分支特征融合动态校正尺度差异。此外,设计几何-外观对比蒸馏损失(GACD),严格区分俯视遮挡。大量实验表明,(MGS)² 达到顶尖性能,在University-1652上召回率@1为97.5%,SUES-200上为97.02%。框架在跨数据集场景下也展现优异泛化能力。代码已开源。
原文摘要 · Abstract (English)
Cross-view geo-localization (CVGL) is pivotal for GNSS-denied UAV navigation but remains brittle under the drastic geometric misalignment between oblique aerial views and orthographic satellite references. Existing methods predominantly operate within a 2D manifold, neglecting the underlying 3D geometry where view-dependent vertical facades (macro-structure) and scale variations (micro-scale) severely corrupt feature alignment. To bridge this gap, we propose (MGS)$^2$, a geometry-grounded framework. The core of our innovation is the Macro-Geometric Structure Filtering (MGSF) module. Unlike pixel-wise matching sensitive to noise, MGSF leverages dilated geometric gradients to physically filter out high-frequency facade artifacts while enhancing the view-invariant horizontal plane, directly addressing the domain shift. To guarantee robust input for this structural filtering, we explicitly incorporate a Micro-Geometric Scale Adaptation (MGSA) module. MGSA utilizes depth priors to dynamically rectify scale discrepancies via multi-branch feature fusion. Furthermore, a Geometric-Appearance Contrastive Distillation (GACD) loss is designed to strictly discriminate against oblique occlusions. Extensive experiments demonstrate that (MGS)$^2$ achieves state-of-the-art performance, recording a Recall@1 of 97.5\% on University-1652 and 97.02\% on SUES-200. Furthermore, the framework exhibits superior cross-dataset generalization against geometric ambiguity. The code is available at: \href{https://github.com/GabrielLi1473/MGS-Net}{https://github.com/GabrielLi1473/MGS-Net}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。