用语义关系生成哈希中心,提升图像检索精度
Deep Hashing with Semantic Hash Centers for Image Retrieval
- 基于语义相似性构建哈希中心,替代传统固定中心
- 在多个数据集上提升平均7.26%~11.71%的检索准确率
- 适合大规模图像检索场景,尤其关注类别语义关系
深度哈希是大规模图像检索的有效方法。现有方法按监督方式可分为点级、对级和列表级。近期点级方法(如CSQ、MDS)通过为每类预设哈希中心,提升了哈希码的区分能力。然而,这些方法依赖与数据无关的算法生成中心,忽视了类别间的语义关系,可能降低检索性能。本文提出语义哈希中心概念,假设语义相关的类别其哈希中心应更接近,无关类别则应更远。为此,我们设计三阶段框架SHC:首先使用数据依赖的相似性计算,训练分类网络识别类别间语义相似性;其次提出优化算法生成保留语义关联的哈希中心,并强制最小距离以避免哈希码过于相似;最后,基于这些语义中心训练深度哈希网络,将图像转换为二进制哈希码。在多个公开数据集上的大规模检索任务实验表明,SHC显著提升性能,在MAP@100、MAP@1000、MAP@ALL指标上分别相比最先进方法提升+7.26%、+7.62%、+11.71%。
原文摘要 · Abstract (English)
Deep hashing is an effective approach for large-scale image retrieval. Current methods are typically classified by their supervision types: point-wise, pair-wise, and list-wise. Recent point-wise techniques (e.g., CSQ, MDS) have improved retrieval performance by pre-assigning a hash center to each class, enhancing the discriminability of hash codes across various datasets. However, these methods rely on data-independent algorithms to generate hash centers, which neglect the semantic relationships between classes and may degrade retrieval performance. This paper introduces the concept of semantic hash centers, building on the idea of traditional hash centers. We hypothesize that hash centers of semantically related classes should have closer Hamming distances, while those of unrelated classes should be more distant. To this end, we propose a three-stage framework, SHC, to generate hash codes that preserve semantic structure. First, we develop a classification network to identify semantic similarities between classes using a data-dependent similarity calculation that adapts to varying data distributions. Second, we introduce an optimization algorithm to generate semantic hash centers, preserving semantic relatedness while enforcing a minimum distance between centers to avoid excessively similar hash codes. Finally, a deep hashing network is trained using these semantic centers to convert images into binary hash codes. Experimental results on large-scale retrieval tasks across several public datasets show that SHC significantly improves retrieval performance. Specifically, SHC achieves average improvements of +7.26%, +7.62%, and +11.71% in MAP@100, MAP@1000, and MAP@ALL metrics, respectively, over state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。