arXiv:2501.01699cs.CVcs.MM2025-01AAAI被引 42

针对噪声标签,提出自适应学习框架提升跨模态哈希检索鲁棒性。

Robust Self-Paced Hashing for Cross-Modal Retrieval with Noisy Labels

  • 通过对比哈希学习减少模态间语义差异,增强多模态一致性。
  • 设计中心聚合学习缓解类内差异,提升特征表达稳定性。
  • 引入噪声容忍的自步学习机制,动态识别并过滤噪声标签。

跨模态哈希(CMH)因其在大规模数据下低存储与高计算效率而成为主流检索技术。现有方法通常假设多模态数据标注正确,但现实中标注不可避免存在噪声,难以获取且成本高昂。受人类认知学习启发,少数方法引入自步学习(SPL)从易到难逐步训练模型,以缓解特征噪声或异常值影响。然而,如何利用SPL减轻噪声标签对哈希模型的误导仍鲜有研究。为此,本文提出一种新型认知式跨模态检索方法——鲁棒自步哈希(RSHNL),模拟人类认知过程,在保持对噪声标签鲁棒性的同时识别噪声。具体而言,首先提出对比哈希学习(CHL)以提升多模态一致性,降低固有语义差距;其次提出中心聚合学习(CAL)以缓解类内差异;最后设计噪声容忍自步哈希(NSH),动态估计每条样本的学习难度,并通过难度区分噪声标签。对所有判定为清洁的样本,进一步采用自步正则化,实现从易到难的渐进式哈希码学习。大量实验表明,RSHNL在多个基准数据集上显著优于现有先进方法。

原文摘要 · Abstract (English)

Cross-modal hashing (CMH) has appeared as a popular technique for cross-modal retrieval due to its low storage cost and high computational efficiency in large-scale data. Most existing methods implicitly assume that multi-modal data is correctly labeled, which is expensive and even unattainable due to the inevitable imperfect annotations (i.e., noisy labels) in real-world scenarios. Inspired by human cognitive learning, a few methods introduce self-paced learning (SPL) to gradually train the model from easy to hard samples, which is often used to mitigate the effects of feature noise or outliers. It is a less-touched problem that how to utilize SPL to alleviate the misleading of noisy labels on the hash model. To tackle this problem, we propose a new cognitive cross-modal retrieval method called Robust Self-paced Hashing with Noisy Labels (RSHNL), which can mimic the human cognitive process to identify the noise while embracing robustness against noisy labels. Specifically, we first propose a contrastive hashing learning (CHL) scheme to improve multi-modal consistency, thereby reducing the inherent semantic gap. Afterward, we propose center aggregation learning (CAL) to mitigate the intra-class variations. Finally, we propose Noise-tolerance Self-paced Hashing (NSH) that dynamically estimates the learning difficulty for each instance and distinguishes noisy labels through the difficulty level. For all estimated clean pairs, we further adopt a self-paced regularizer to gradually learn hash codes from easy to hard. Extensive experiments demonstrate that the proposed RSHNL performs remarkably well over the state-of-the-art CMH methods.

跨模态检索哈希学习噪声标签自步学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。