通过自适应聚类实现无监督视角分类,提升视觉定位鲁棒性
MutualVPR: A Mutual Learning Framework for Resolving Supervision Inconsistencies via Adaptive Clustering
- 采用DINOv2初始化聚类,迭代优化无标签视角分组
- 在多个数据集上达到当前最优性能,显著提升视角泛化能力
- 适合需要高鲁棒性的机器人定位与自动驾驶场景
视觉位置识别(VPR)通过学习的描述子进行图像检索实现鲁棒定位。然而,同一地点因视角变化导致的图像外观剧烈差异会引发监督信号不一致,进而损害描述子学习。现有方法依赖人工裁剪规则或标注数据区分视角,存在两大局限:(1) 依赖标签或手工规则限制泛化能力;(2) 即使同视角下,遮挡仍会引入特征模糊。为此,我们提出MutualVPR,一种融合无监督视角自分类与描述子学习的互学习框架。首先按地理坐标分组图像,再使用K-means迭代优化聚类,动态分配地点类别而无需方向标签。具体地,采用基于DINOv2的编码器初始化聚类。训练过程中,编码器与聚类共同演化,逐步分离同一地点的剧烈外观差异,实现一致监督。此外,捕捉地点内细粒度图像差异可增强鲁棒性。实验表明,MutualVPR在多个数据集上达到当前最优性能,验证了该框架在提升视角方向泛化性和遮挡鲁棒性方面的有效性。
原文摘要 · Abstract (English)
Visual Place Recognition (VPR) enables robust localization through image retrieval based on learned descriptors. However, drastic appearance variations of images at the same place caused by viewpoint changes can lead to inconsistent supervision signals, thereby degrading descriptor learning. Existing methods either rely on manually defined cropping rules or labeled data for view differentiation, but they suffer from two major limitations: (1) reliance on labels or handcrafted rules restricts generalization capability; (2) even within the same view direction, occlusions can introduce feature ambiguity. To address these issues, we propose MutualVPR, a mutual learning framework that integrates unsupervised view self-classification and descriptor learning. We first group images by geographic coordinates, then iteratively refine the clusters using K-means to dynamically assign place categories without orientation labels. Specifically, we adopt a DINOv2-based encoder to initialize the clustering. During training, the encoder and clustering co-evolve, progressively separating drastic appearance variations of the same place and enabling consistent supervision. Furthermore, we find that capturing fine-grained image differences at a place enhances robustness. Experiments demonstrate that MutualVPR achieves state-of-the-art (SOTA) performance across multiple datasets, validating the effectiveness of our framework in improving view direction generalization, occlusion robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。