arXiv:2412.08618cs.CVcs.AI2024-12

用差异空间替代欧式空间,提升图像检索精度

Image Retrieval Methods in the Dissimilarity Space

  • 将查询与参考特征映射到单一差异空间进行匹配
  • 端到端训练使模型在多个数据集上准确率显著提升
  • 特别适合噪声多、复杂场景下的实际应用

图像检索依赖度量学习训练骨干特征提取模型,以获取可区分的查询与参考(画廊)特征表示进行相似性匹配。尽管深度学习模型在大规模数据集上训练后准确率大幅提升,但在真实世界视频分析与监控应用(如行人重识别)中仍具挑战性。使用欧氏空间匹配受限于维度灾难、过拟合及对噪声敏感等问题。本文认为特征差异空间更适合作为相似性匹配空间,提出一种二分变换将查询和参考嵌入投影至单一差异空间嵌入。我们主张联合训练骨干网络与二分类模型进行成对匹配。相比直接比较查询与参考嵌入的距离,我们证明对单一差异空间嵌入进行相似性/不相似性分类更具优势,尤其在端到端训练时。通过施加分类器权重L2范数约束与铰链损失,实现最大间隔分类器与骨干特征提取器的联合训练。大量实验在多个具有挑战性的图像检索数据集上验证了差异空间匹配的优势。特别是当联合训练特征提取骨干与正则化分类器时,差异空间可提供更高准确率。

原文摘要 · Abstract (English)

Image retrieval methods rely on metric learning to train backbone feature extraction models that can extract discriminant queries and reference (gallery) feature representations for similarity matching. Although state-of-the-art accuracy has improved considerably with the advent of deep learning (DL) models trained on large datasets, image retrieval remains challenging in many real-world video analytics and surveillance applications, e.g., person re-identification. Using the Euclidean space for matching limits the performance in real-world applications due to the curse of dimensionality, overfitting, and sensitivity to noisy data. We argue that the feature dissimilarity space is more suitable for similarity matching, and propose a dichotomy transformation to project query and reference embeddings into a single embedding in the dissimilarity space. We also advocate for end-to-end training of a backbone and binary classification models for pair-wise matching. As opposed to comparing the distance between queries and reference embeddings, we show the benefits of classifying the single dissimilarity space embedding (as similar or dissimilar), especially when trained end-to-end. We propose a method to train the max-margin classifier together with the backbone feature extractor by applying constraints to the L2 norm of the classifier weights along with the hinge loss. Our extensive experiments on challenging image retrieval datasets and using diverse feature extraction backbones highlight the benefits of similarity matching in the dissimilarity space. In particular, when jointly training the feature extraction backbone and regularised classifier for matching, the dissimilarity space provides a higher level of accuracy.

图像检索差异空间度量学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。