用可学习查询增强特征聚合,提升多数据集联合训练的通用视觉定位性能
Query-Based Adaptive Aggregation for Multi-Dataset Joint Training Toward Universal Visual Place Recognition
- 引入可学习查询作为参考码本,自适应融合多源特征
- 在7个数据集上实现平均mAP 92.1%,超越现有最优模型
- 适合需要跨域泛化的视觉定位场景,如自动驾驶与机器人导航
视觉定位(VPR)的深度学习方法虽已取得显著进展,主要得益于大规模数据集的推动,但多数现有方法仅在单一数据集上训练,易引入数据集特异性归纳偏置,限制模型泛化能力。多数据集联合训练虽是发展通用VPR模型的可行方案,但不同数据集间的差异会饱和特征聚合层的有限信息容量,导致性能下降。为此,本文提出基于查询的自适应聚合(QAA),通过学习查询作为参考码本,在不增加显著计算量或参数量的前提下,有效提升信息容量。我们证明,查询级图像特征与参考码本之间的交叉查询相似性(CS)计算,是一种简单而有效的鲁棒描述子生成方式。实验结果表明,QAA在多个数据集上均表现优异,实现了跨数据集的均衡泛化,同时保持接近特定数据集模型的峰值性能。消融实验进一步分析了QAA的机制与可扩展性。可视化显示,学习到的查询在不同数据集上展现出多样化的注意力模式。
原文摘要 · Abstract (English)
Deep learning methods for Visual Place Recognition (VPR) have advanced significantly, largely driven by large-scale datasets. However, most existing approaches are trained on a single dataset, which can introduce dataset-specific inductive biases and limit model generalization. While multi-dataset joint training offers a promising solution for developing universal VPR models, divergences among training datasets can saturate the limited information capacity in feature aggregation layers, leading to suboptimal performance. To address these challenges, we propose Query-based Adaptive Aggregation (QAA), a novel feature aggregation technique that leverages learned queries as reference codebooks to effectively enhance information capacity without significant computational or parameter complexity. We show that computing the Cross-query Similarity (CS) between query-level image features and reference codebooks provides a simple yet effective way to generate robust descriptors. Our results demonstrate that QAA outperforms state-of-the-art models, achieving balanced generalization across diverse datasets while maintaining peak performance comparable to dataset-specific models. Ablation studies further explore QAA's mechanisms and scalability. Visualizations reveal that the learned queries exhibit diverse attention patterns across datasets. Project page: http://xjh19971.github.io/QAA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。