无需卫星数据训练,用无人机多视角图像实现精准地理定位。
Satellite-Free Training for Drone-View Geo-Localization
- 通过3D重建与伪正射影像生成,将无人机图像转为可跨视角检索的表示
- 在University-1652和SUES-200上超越现有无卫星训练方法,接近有卫星训练性能
- 适合无卫星数据可用场景,如军事、隐私敏感区域的无人机定位
无人机视图地理定位(DVGL)旨在通过从参考图库中检索对应地理标记的卫星瓦片,确定无人机在无GPS环境中的位置。现有方法通常使用单张倾斜无人机图像作为观测。本文提出一种无需卫星数据的训练框架(SFT),适用于多视角无人机序列。首先利用3D Gaussian splatting重建密集三维场景,并通过PCA引导的正交投影生成伪正射影像;接着采用轻量级几何引导修复填补纹理缺失;最后从生成的正射影像中提取DINOv3块特征,仅基于无人机数据学习费舍尔向量聚合模型,用于测试时编码卫星瓦片以实现跨视角检索。在University-1652和SUES-200数据集上的实验表明,该方法显著优于现有无卫星训练基线,缩小了与有卫星训练方法的差距。
原文摘要 · Abstract (English)
Drone-view geo-localization (DVGL) aims to determine the location of drones in GPS-denied environments by retrieving the corresponding geotagged satellite tile from a reference gallery given UAV observations of a location. In many existing formulations, these observations are represented by a single oblique UAV image. In contrast, our satellite-free setting is designed for multi-view UAV sequences, which are used to construct a geometry-normalized UAV-side location representation before cross-view retrieval. Existing approaches rely on satellite imagery during training, either through paired supervision or unsupervised alignment, which limits practical deployment when satellite data are unavailable or restricted. In this paper, we propose a satellite-free training (SFT) framework that converts drone imagery into cross-view compatible representations through three main stages: drone-side 3D scene reconstruction, geometry-based pseudo-orthophoto generation, and satellite-free feature aggregation for retrieval. Specifically, we first reconstruct dense 3D scenes from multi-view drone images using 3D Gaussian splatting and project the reconstructed geometry into pseudo-orthophotos via PCA-guided orthographic projection. This rendering stage operates directly on reconstructed scene geometry without requiring camera parameters at rendering time. Next, we refine these orthophotos with lightweight geometry-guided inpainting to obtain texture-complete drone-side views. Finally, we extract DINOv3 patch features from the generated orthophotos, learn a Fisher vector aggregation model solely from drone data, and reuse it at test time to encode satellite tiles for cross-view retrieval. Experimental results on University-1652 and SUES-200 show that our SFT framework substantially outperforms satellite-free generalization baselines and narrows the gap to methods trained with satellite imagery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。