通过智能生成难样本提升视觉定位在复杂环境下的鲁棒性
AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognition

- 基于场景理解与编辑可行性评估,设计三类生成路径
- 构建16万张经验证的同地点难样本,使识别率提升9.2%
- 适合需要强泛化能力的自动驾驶与机器人定位任务
视觉定位(VPR)通过检索相同或邻近位置的图像实现查询定位,但光照、天气、季节变化和动态遮挡等域偏移会显著降低其性能。现有训练数据中同一地点的外观多样性有限是主要原因。为此,本文提出AdaptVPR,一种路线感知的生成增强框架,用于构建更具挑战性的同地点难正样本以提升训练效果。该框架首先利用视觉语言模型解析场景属性并估计编辑可行性,再由规则调度器根据可编辑性评分与风险约束决定生成路径。生成过程分为三类互补路径:全局外观路径引入天气、光照和时段的全局变化;局部遮挡路径插入合理的动态遮挡物;双路径则结合两者产生更复杂的外观扰动。每条生成候选均通过基于几何一致性与外观多样性的验证方案评估,避免结构漂移的同时确保足够外观变化。全局候选生成一次,失败即剔除;局部遮挡与双路径候选则根据验证反馈进行有限提示调整与重生成。基于此框架,我们构建了AdaptCities数据集,包含16万张经验证的合成同地点难正样本。在多个VPR基线与视觉基础模型上实验表明,该方法在标准基准上持续增益,并在极端域偏移下表现显著提升,最高达R@1提升9.2%。代码与数据已公开于https://github.com/chenshunpeng/AdaptVPR。
原文摘要 · Abstract (English)
Visual Place Recognition (VPR) localizes a query image by retrieving database images of the same or nearby place, yet its robustness is often degraded by domain shifts arising from illumination, weather, seasonal changes, and dynamic occlusions. One contributing factor is the limited appearance diversity of the same place in existing training data. To address this issue, we propose AdaptVPR, a route-aware generative augmentation framework that constructs same-place hard positives for robust VPR training. AdaptVPR first uses a vision language model to parse scene attributes and estimate editing feasibility, while a rule-based scheduler determines the generation route according to editability scores and risk constraints. The generation process is decomposed into three complementary routes: the Global Appearance Route introduces global scene changes in weather, illumination, and time of day; the Local Occlusion Route inserts plausible dynamic occluders; and the Dual Route combines both types of perturbations to produce more challenging appearance shifts. Each generated candidate is evaluated using a VPR-oriented verification scheme based on geometric consistency and appearance diversity, reducing the risk of structural drift while ensuring sufficient appearance variation. Global candidates are generated once and rejected if verification fails, while Local Occlusion and Dual candidates use verification feedback for limited prompt refinement and regeneration. Using this framework, we construct AdaptCities, containing 160K verified synthetic same-place hard positives. Experiments across multiple VPR baselines and vision foundation backbones show consistent gains on standard benchmarks and substantial improvements under challenging domain shifts, with R@1 gains of up to 9.2%. The source code and data resources are publicly available at https://github.com/chenshunpeng/AdaptVPR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。