用游戏数据构建大范围无人机定位基准,提升真实场景泛化能力
Game4Loc: A UAV Geo-Localization Benchmark from Game Data
- 基于游戏生成多视角、多高度的无人机与卫星图像对
- 支持部分匹配和米级精度定位,更贴近实际应用
- 采用对比学习方法避免额外匹配步骤,训练更高效
基于视觉的无人机地理定位技术可作为卫星导航系统的备用方案,在无GPS环境下仍能独立工作。近年来的方法将此任务视为图像匹配与检索,通过在带有地理标签的卫星图像数据库中检索无人机视角图像来获得近似定位信息。然而,由于成本高和隐私问题,连续区域的无人机图像难以获取,现有数据集多为小规模航拍图像,且假设查询图像与参考图像存在完美一一对应,与实际场景差距较大。本文构建了一个名为GTA-UAV的大范围连续区域无人机地理定位数据集,利用现代电子游戏生成包含多种飞行高度、姿态、场景和目标的图像对。基于该数据集,提出更贴近实际的无人机定位任务,涵盖跨视角部分匹配,并将图像级检索扩展为距离(米)级定位。针对图像对构建,采用基于权重的对比学习方法,实现有效学习且无需额外后处理匹配步骤。实验表明,该数据集和训练方法在无人机定位上有效,且具备向真实场景的良好泛化能力。
原文摘要 · Abstract (English)
The vision-based geo-localization technology for UAV, serving as a secondary source of GPS information in addition to the global navigation satellite systems (GNSS), can still operate independently in the GPS-denied environment. Recent deep learning based methods attribute this as the task of image matching and retrieval. By retrieving drone-view images in geo-tagged satellite image database, approximate localization information can be obtained. However, due to high costs and privacy concerns, it is usually difficult to obtain large quantities of drone-view images from a continuous area. Existing drone-view datasets are mostly composed of small-scale aerial photography with a strong assumption that there exists a perfect one-to-one aligned reference image for any query, leaving a significant gap from the practical localization scenario. In this work, we construct a large-range contiguous area UAV geo-localization dataset named GTA-UAV, featuring multiple flight altitudes, attitudes, scenes, and targets using modern computer games. Based on this dataset, we introduce a more practical UAV geo-localization task including partial matches of cross-view paired data, and expand the image-level retrieval to the actual localization in terms of distance (meters). For the construction of drone-view and satellite-view pairs, we adopt a weight-based contrastive learning approach, which allows for effective learning while avoiding additional post-processing matching steps. Experiments demonstrate the effectiveness of our data and training method for UAV geo-localization, as well as the generalization capabilities to real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。