arXiv:2505.08961cs.CVcs.LG2025-05

通过优化注意力权重的语义信息量,提升行人重识别准确率。

Learning Informative Attention Weights for Person Re-Identification

  • 设计新损失函数RIB,让注意力权重更聚焦于身份相关特征。
  • 在多个基准上显著提升行人重识别精度,尤其对遮挡情况有效。
  • 适用于多种注意力结构,适合追求高精度Re-ID的研究者。

注意力机制广泛应用于深度学习,近期研究将其引入深度神经网络(DNN)以增强行人重识别(Re-ID)的判别性特征学习能力。现有注意力模块(如自注意力、通道注意力)虽能学习特征块或通道的重要性权重,但未显式确保这些权重对预测图像中人物身份具有信息量,可能引入噪声。为此,本文提出基于信息瓶颈(IB)原理的新型方法——信息瓶颈损失缩减(RIB)。推导出一种无需分布假设且可由标准SGD优化的变分上界(IBB),并融入RIB训练损失。RIB通过新型可微通道选择注意力模块(DCS-Attention)应用于自注意力网络,构建出竞争性模型RIB-DCS;同时也可嵌入已有通道注意力模块,生成RIB-CA模型。二者均在固定与可学习骨干网络(含可微神经架构搜索DNAS)上测试。大量实验表明,RIB显著提升DNN在多个行人重识别基准上的预测精度,即使在遮挡场景下仍表现优异。

原文摘要 · Abstract (English)

Attention mechanisms have been widely used in deep learning, and recent efforts have been devoted to incorporating attention modules into deep neural networks (DNNs) for person Re-Identification (Re-ID) to enhance their discriminative feature learning capabilities. Existing attention modules, including self-attention and channel attention, learn attention weights that quantify the importance of feature tokens or feature channels. However, existing attention methods do not explicitly ensure that the attention weights are informative for predicting the identity of the person in the input image, and may consequently introduce noisy information from the input image. To address this issue, we propose a novel method termed Reduction of Information Bottleneck loss (RIB), motivated by the principle of the Information Bottleneck (IB). A novel distribution-free and efficient variational upper bound for the IB loss (IBB), which can be optimized by standard SGD, is derived and incorporated into the training loss of the RIB models. RIB is applied to DNNs with self-attention modules through a novel Differentiable Channel Selection Attention module, or DCS-Attention, that selects the most informative channels for computing attention weights, leading to competitive models termed RIB-DCS. RIB is also incorporated into DNNs with existing channel attention modules to promote the learning of informative channel attention weights, leading to models termed RIB-CA. Both RIB-DCS and RIB-CA are applied to fixed neural network backbones and learnable backbones with Differentiable Neural Architecture Search (DNAS). Extensive experiments on multiple person Re-ID benchmarks show that RIB significantly enhances the prediction accuracy of DNNs for person Re-ID, even for the occluded person Re-ID.

行人重识别注意力机制信息瓶颈特征学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。