无需配对标注数据,通过自监督学习实现无人机地理定位
Without Paired Labeled Data: End-to-End Self-Supervised Learning for Drone-view Geo-Localization

- 用聚类生成伪标签,双路径对比学习提升特征区分性
- 在三个公开数据集上超越多数自监督方法,接近甚至超过有监督模型
- 适合无标注数据场景,尤其适用于跨区域部署的无人机定位
无人机视角地理定位(DVGL)旨在通过检索最相关的带GPS标签的卫星图像来实现无人机精确定位。然而,现有方法严重依赖严格配对的无人机-卫星图像进行监督学习。当目标区域发生变化时,通常需要新增配对样本以适应分布变化。标注成本高且模型迁移能力弱,极大限制了DVGL在开放世界中的实际应用。为此,本文提出一种新型端到端自监督学习方法——动态记忆驱动与邻域信息学习(DMNIL),采用轻量骨干网络。该方法利用聚类算法生成伪标签,并采用双路径对比学习框架学习视图内判别性表示。此外,DMNIL引入两个核心模块:动态分层记忆学习(DHML)模块结合短期与长期记忆,增强视图内特征一致性与判别性;信息一致性演化学习(ICEL)模块通过邻域驱动的动态约束机制,系统捕捉隐式跨视图语义关联,从而提升跨视图特征对齐。为进一步稳定和强化自监督训练过程,提出伪标签增强策略以提高伪监督质量。在三个公开基准数据集上的大量实验表明,所提方法持续优于现有自监督方法,甚至超越多个先进有监督方法。代码已开源:https://github.com/ISChenawei/DMNIL。
原文摘要 · Abstract (English)
Drone-view Geo-Localization (DVGL) aims to achieve accurate localization of drones by retrieving the most relevant GPS-tagged satellite images. However, most existing methods heavily rely on strictly pre-paired drone-satellite images for supervised learning. When the target region shifts, new paired samples are typically required to adapt to the distribution changes. The high cost of annotation and the limited transferability of these methods significantly hinder the practical deployment of DVGL in open-world scenarios. To address these limitations, we propose a novel end-to-end self-supervised learning method with a shallow backbone network, called the dynamic memory-driven and neighborhood information learning (DMNIL) method. It employs a clustering algorithm to generate pseudo-labels and adopts a dual-path contrastive learning framework to learn discriminative intra-view representations. Furthermore, DMNIL incorporates two core modules, including the dynamic hierarchical memory learning (DHML) module and the information consistency evolution learning (ICEL) module. The DHML module combines short-term and long-term memory to enhance intra-view feature consistency and discriminability. Meanwhile, the ICEL module utilizes a neighborhood-driven dynamic constraint mechanism to systematically capture implicit cross-view semantic correlations, consequently improving cross-view feature alignment. To further stabilize and strengthen the self-supervised training process, a pseudo-label enhancement strategy is introduced to enhance the quality of pseudo supervision. Extensive experiments on three public benchmark datasets demonstrate that the proposed method consistently outperforms existing self-supervised methods and even surpasses several state-of-the-art supervised methods. Our code is available at https://github.com/ISChenawei/DMNIL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。