用分割引导蒸馏,让单张图像同时具备结构与语义信息,提升定位精度和速度。
StructVPR++: Distill Structural and Semantic Knowledge with Weighting Samples for Visual Place Recognition
- 通过分割引导蒸馏,将结构与语义知识注入全局特征
- 在四个基准上Recall@1提升5%-23%,达到实时效率
- 适合需要高精度与低延迟的自动驾驶与机器人场景
视觉位置识别是自动驾驶与机器人领域的关键挑战,通常被视为图像检索问题。常用两阶段策略包括全局检索与基于局部描述子的重排序。大多数端到端深度学习方法无法从RGB图像中提取足够语义信息的全局特征;而重排序虽能利用更明确的结构与语义信息进行一对一匹配,但计算耗时。为弥合全局检索与重排序之间的差距,实现准确率与效率的平衡,我们提出StructVPR++,通过分割引导蒸馏将结构与语义知识嵌入RGB全局表示。核心创新在于解耦标签相关特征,实现图像对间显式语义对齐,且部署时无需分割。此外,引入样本加权蒸馏策略,优先可靠训练对,抑制噪声样本。在四个基准上的实验表明,StructVPR++在Recall@1上超越现有全局方法5%-23%,甚至优于许多两阶段方法,且仅需单张RGB输入即可实现实时性能。
原文摘要 · Abstract (English)
Visual place recognition is a challenging task for autonomous driving and robotics, which is usually considered as an image retrieval problem. A commonly used two-stage strategy involves global retrieval followed by re-ranking using patch-level descriptors. Most deep learning-based methods in an end-to-end manner cannot extract global features with sufficient semantic information from RGB images. In contrast, re-ranking can utilize more explicit structural and semantic information in one-to-one matching process, but it is time-consuming. To bridge the gap between global retrieval and re-ranking and achieve a good trade-off between accuracy and efficiency, we propose StructVPR++, a framework that embeds structural and semantic knowledge into RGB global representations via segmentation-guided distillation. Our key innovation lies in decoupling label-specific features from global descriptors, enabling explicit semantic alignment between image pairs without requiring segmentation during deployment. Furthermore, we introduce a sample-wise weighted distillation strategy that prioritizes reliable training pairs while suppressing noisy ones. Experiments on four benchmarks demonstrate that StructVPR++ surpasses state-of-the-art global methods by 5-23% in Recall@1 and even outperforms many two-stage approaches, achieving real-time efficiency with a single RGB input.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。