提出新模型QdaVPR,让机器人在不同季节、昼夜和天气下都能准确定位。
QdaVPR: A novel query-based domain-agnostic model for visual place recognition
- 用双层对抗学习让特征忽略环境变化影响
- 在多个数据集上达到93.5%以上召回率,最优表现
- 适合需要跨域定位的自动驾驶与机器人应用
视觉位置识别(VPR)是机器人和自动驾驶系统中的基础任务,旨在仅凭图像视觉特征预测其位置。领域差异仍是主要挑战且研究不足。现有模型要么在包含多样性的大规模数据集上训练(缺乏显式领域监督),要么针对特定领域适配(泛化能力差)。本文提出新型查询式无领域依赖的VPR模型QdaVPR。首先设计双层对抗学习框架,促使查询特征(全局描述符)及其来源图像特征均具备领域不变性;其次采用基于查询组合的三元组监督,增强全局描述符的判别能力。为支持训练,利用风格迁移扩充大规模VPR数据集,生成多种合成领域并附带领域标签作为辅助监督。大量实验表明,QdaVPR在多个含显著领域差异的基准上达到领先性能:在Nordland(季节变化)上达93.5%/98.6%的Recall@1/@10;在Tokyo24/7(昼夜转换)上达97.5%/99.0%;在SVOX数据集几乎所有天气条件下均取得最高Recall@1。代码将开源。
原文摘要 · Abstract (English)
Visual place recognition (VPR) aiming at predicting the location of an image based solely on its visual features is a fundamental task in robotics and autonomous systems. Domain variation remains one of the main challenges in VPR and is relatively unexplored. Existing VPR models attempt to achieve domain agnosticism either by training on large-scale datasets that inherently contain some domain variations, or by being specifically adapted to particular target domains. In practice, the former lacks explicit domain supervision, while the latter generalizes poorly to unseen domain shifts. This paper proposes a novel query-based domain-agnostic VPR model called QdaVPR. First, a dual-level adversarial learning framework is designed to encourage domain invariance for both the query features forming the global descriptor and the image features from which these query features are derived. Then, a triplet supervision based on query combinations is designed to enhance the discriminative power of the global descriptors. To support the learning process, we augment a large-scale VPR dataset using style transfer methods, generating various synthetic domains with corresponding domain labels as auxiliary supervision. Extensive experiments show that QdaVPR achieves state-of-the-art performance on multiple VPR benchmarks with significant domain variations. Specifically, it attains the best Recall@1 and Recall@10 on nearly all test scenarios: 93.5%/98.6% on Nordland (seasonal changes), 97.5%/99.0% on Tokyo24/7 (day-night transitions), and the highest Recall@1 across almost all weather conditions on the SVOX dataset. Our code will be released at https://github.com/shuimushan/QdaVPR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。