解决视觉定位中特征冗余与计算慢问题,提升识别精度与速度
VLAD-BuFF: Burst-aware Fast Feature Aggregation for Visual Place Recognition
- 基于自相似性动态抑制重复特征,实现端到端的抗冗余学习
- 通过PCA初始化投影降维,使特征维度降低12倍仍保持高召回率
- 适合对实时性与准确率要求高的机器人定位场景
视觉位置识别(VPR)是具身智能体视觉定位的关键组件,通常被建模为图像检索任务,旨在联合学习局部特征与聚合方法。当前最先进方法依赖VLAD聚合,可通过软分配学习特征对聚类中心的加权贡献。但该方法存在两大缺陷:一是未考虑聚类内重复结构(如阴影、窗框)导致的特征过载(即‘突发性’问题),传统做法是聚合前手动剔除重复特征;二是高维局部特征与聚类中心的对比计算开销大。本文提出VLAD-BuFF,引入两项创新:(1)基于自相似性的特征折扣机制,可在端到端训练中学习抗突发性特征;(2)通过PCA初始化可学习预投影降低局部特征维度,实现快速聚合。在9个公开数据集上的实验表明,该方法达到新基准性能,即使局部特征维度降低12倍,仍保持高召回率,显著提升聚合效率。定性分析显示,所提权重机制能有效抑制非独特特征。
原文摘要 · Abstract (English)
Visual Place Recognition (VPR) is a crucial component of many visual localization pipelines for embodied agents. VPR is often formulated as an image retrieval task aimed at jointly learning local features and an aggregation method. The current state-of-the-art VPR methods rely on VLAD aggregation, which can be trained to learn a weighted contribution of features through their soft assignment to cluster centers. However, this process has two key limitations. Firstly, the feature-to-cluster weighting does not account for over-represented repetitive structures within a cluster, e.g., shadows or window panes; this phenomenon is also referred to as the `burstiness' problem, classically solved by discounting repetitive features before aggregation. Secondly, feature to cluster comparisons are compute-intensive for state-of-the-art image encoders with high-dimensional local features. This paper addresses these limitations by introducing VLAD-BuFF with two novel contributions: i) a self-similarity based feature discounting mechanism to learn Burst-aware features within end-to-end VPR training, and ii) Fast Feature aggregation by reducing local feature dimensions specifically through PCA-initialized learnable pre-projection. We benchmark our method on 9 public datasets, where VLAD-BuFF sets a new state of the art. Our method is able to maintain its high recall even for 12x reduced local feature dimensions, thus enabling fast feature aggregation without compromising on recall. Through additional qualitative studies, we show how our proposed weighting method effectively downweights the non-distinctive features. Source code: https://github.com/Ahmedest61/VLAD-BuFF/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。