通过弱监督互学习,让哈希模型同时捕捉局部与全局信息。
Mutual Learning for Hashing: Unlocking Strong Hash Functions from Weak Supervision
- 用成对方法学局部相似性,中心方法学全局分布,双向互学。
- 在多个数据集上超越现有最佳哈希方法,提升显著。
- 适合做大规模图像检索的开发者,尤其关注性能与效率者。
深度哈希广泛应用于大规模图像检索,现有方法多聚焦于优化哈希函数学习。基于成对关系的方法能有效保留局部相似性,而基于中心的方法则因更好建模全局数据分布而表现更优。然而,中心方法在建模全局结构时往往忽略了重要的局部相似信息。为此,本文提出互学习哈希(MLH),一种从弱监督到强监督的新型框架,通过将成对分支学到的局部相似性知识迁移到中心分支,增强其性能。MLH包含一个强中心分支和一个弱成对分支,二者通过迭代互学机制协同优化。此外,受专家混合模型启发,引入混合哈希专家模块,实现分支间高效交互,进一步提升两分支表现。大量实验表明,MLH在多个基准数据集上持续优于当前最优哈希方法。
原文摘要 · Abstract (English)
Deep hashing has been widely adopted for large-scale image retrieval, with numerous strategies proposed to optimize hash function learning. Pairwise-based methods are effective in learning hash functions that preserve local similarity relationships, whereas center-based methods typically achieve superior performance by more effectively capturing global data distributions. However, the strength of center-based methods in modeling global structures often comes at the expense of underutilizing important local similarity information. To address this limitation, we propose Mutual Learning for Hashing (MLH), a novel weak-to-strong framework that enhances a center-based hashing branch by transferring knowledge from a weaker pairwise-based branch. MLH consists of two branches: a strong center-based branch and a weaker pairwise-based branch. Through an iterative mutual learning process, the center-based branch leverages local similarity cues learned by the pairwise-based branch. Furthermore, inspired by the mixture-of-experts paradigm, we introduce a novel mixture-of-hash-experts module that enables effective cross-branch interaction, further enhancing the performance of both branches. Extensive experiments demonstrate that MLH consistently outperforms state-of-the-art hashing methods across multiple benchmark datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。