arXiv:2511.12528cs.CV2025-11AAAI被引 2

用知识蒸馏和可变形聚合,让大模型在小设备上高效识别位置。

D$^{2}$-VPR: A Parameter-efficient Visual-foundation-model-based Visual Place Recognition Method via Knowledge Distillation and Deformable Aggregation

  • 两阶段训练结合知识蒸馏与微调,保留大模型特征能力。
  • 参数量减少64.2%,在多个数据集上表现接近顶尖方法。
  • 适合资源受限设备部署,尤其适用于移动机器人定位场景。

视觉位置识别(VPR)旨在通过检索地理标记参考库中与查询图像最相似的图像来确定其地理位置。近期,基于自监督训练的大规模视觉基础模型DINOv2显著提升了VPR性能,得益于其出色的特征泛化能力,但随之带来的模型复杂度和计算开销阻碍了在资源受限设备上的部署。为此,本文提出D²-VPR,一种基于知识蒸馏与可变形聚合的轻量化框架,在保持视觉基础模型强大特征提取能力的同时,显著降低参数量并实现更优的性能-效率权衡。具体而言,首先采用两阶段训练策略,融合知识蒸馏与微调,并引入蒸馏恢复模块(DRM)以更好对齐师生模型特征空间,最大限度减少知识迁移损失;其次设计基于自上而下注意力的可变形聚合器(TDDA),利用全局语义特征动态自适应调整感兴趣区域(ROI),提升对不规则结构的适应性。大量实验表明,该方法在性能上与现有最优方法相当,同时参数量相较CricaVPR减少约64.2%。代码已开源。

原文摘要 · Abstract (English)

Visual Place Recognition (VPR) aims to determine the geographic location of a query image by retrieving its most visually similar counterpart from a geo-tagged reference database. Recently, the emergence of the powerful visual foundation model, DINOv2, trained in a self-supervised manner on massive datasets, has significantly improved VPR performance. This improvement stems from DINOv2's exceptional feature generalization capabilities but is often accompanied by increased model complexity and computational overhead that impede deployment on resource-constrained devices. To address this challenge, we propose $D^{2}$-VPR, a $D$istillation- and $D$eformable-based framework that retains the strong feature extraction capabilities of visual foundation models while significantly reducing model parameters and achieving a more favorable performance-efficiency trade-off. Specifically, first, we employ a two-stage training strategy that integrates knowledge distillation and fine-tuning. Additionally, we introduce a Distillation Recovery Module (DRM) to better align the feature spaces between the teacher and student models, thereby minimizing knowledge transfer losses to the greatest extent possible. Second, we design a Top-Down-attention-based Deformable Aggregator (TDDA) that leverages global semantic features to dynamically and adaptively adjust the Regions of Interest (ROI) used for aggregation, thereby improving adaptability to irregular structures. Extensive experiments demonstrate that our method achieves competitive performance compared to state-of-the-art approaches. Meanwhile, it reduces the parameter count by approximately 64.2% (compared to CricaVPR).Code is available at https://github.com/tony19980810/D2VPR.

视觉定位知识蒸馏轻量化可变形聚合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。