通过全局关联建模生成更难且多样的负样本,提升度量学习性能。
Globally Correlation-Aware Hard Negative Generation
- 构建结构化图模型,全局捕获样本间相关性。
- 在四个图像检索数据集上优于现有方法,显著提升精度。
- 适合需要高质量负样本的度量学习研究者使用。
硬负样本生成旨在生成有助于确定决策边界、从而推动深度度量学习发展的信息丰富负样本。现有方法通常选择样本对或三元组,学习其局部相关性并融合以生成硬负样本。然而,这些方法仅考虑所选样本的局部相关性,忽略了能提供更显著信息的全局样本相关性。本文提出一种全局相关性感知的硬负样本生成框架(GCA-HNG),首先从全局视角学习样本相关性,并利用这些相关性指导生成适应硬度和多样性的负样本。具体地,该方法先构建结构化图来建模样本相关性,其中每个节点代表一个样本,每条边代表对应样本间的相关性;随后引入迭代图消息传播机制,在整个图中传播节点与边的消息,从而实现全局相关性学习;最后,基于学习到的全局相关性,提出通道自适应方式组合锚点与多个负样本进行硬负样本生成。相比现有方法,GCA-HNG能够从全局和全面视角感知大量负样本的相关性,生成具有更好硬度与多样性的负样本。大量实验结果表明,所提方法在四个图像检索基准数据集上均优于现有方法。代码与训练模型已开源于:https://github.com/PWenJay/GCA-HNG。
原文摘要 · Abstract (English)
Hard negative generation aims to generate informative negative samples that help to determine the decision boundaries and thus facilitate advancing deep metric learning. Current works select pair/triplet samples, learn their correlations, and fuse them to generate hard negatives. However, these works merely consider the local correlations of selected samples, ignoring global sample correlations that would provide more significant information to generate more informative negatives. In this work, we propose a Globally Correlation-Aware Hard Negative Generation (GCA-HNG) framework, which first learns sample correlations from a global perspective and exploits these correlations to guide generating hardness-adaptive and diverse negatives. Specifically, this approach begins by constructing a structured graph to model sample correlations, where each node represents a specific sample and each edge represents the correlations between corresponding samples. Then, we introduce an iterative graph message propagation to propagate the messages of node and edge through the whole graph and thus learn the sample correlations globally. Finally, with the guidance of the learned global correlations, we propose a channel-adaptive manner to combine an anchor and multiple negatives for HNG. Compared to current methods, GCA-HNG allows perceiving sample correlations with numerous negatives from a global and comprehensive perspective and generates the negatives with better hardness and diversity. Extensive experiment results demonstrate that the proposed GCA-HNG is superior to related methods on four image retrieval benchmark datasets. Codes and trained models are available at \url{https://github.com/PWenJay/GCA-HNG}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。