arXiv:2410.15613cs.CV2024-10被引 7

提出无负样本对比学习框架,提升遮挡下行人重识别性能

Exploring Stronger Transformer Representation Learning for Occluded Person Re-Identification

  • 设计无负样本对比分支,结合随机矩形遮蔽模拟真实遮挡
  • 在多个数据集上mAP和Rank-1准确率显著优于现有方法
  • 适合关注遮挡场景下特征学习的视觉识别研究者

由于遮挡、姿态变化和多视角等复杂因素,行人重识别中提取强特征表示仍具挑战。本文提出一种新型自监督与监督结合的Transformer框架SSSC-TransReID。不同于传统Transformer模型,我们设计了一个无需负样本或预训练的自监督对比学习分支,并引入新颖的随机矩形遮蔽策略,以模拟真实场景中的遮挡,增强对遮挡的鲁棒性。通过联合训练损失函数,融合标签监督与无负样本对比学习的优势,强化模型挖掘判别性特征的能力,尤其在遮挡条件下表现突出。大量实验表明,该模型在多个基准数据集上持续取得优异性能,在mAP和Rank-1准确率上大幅超越当前最优方法。

原文摘要 · Abstract (English)

Due to some complex factors (e.g., occlusion, pose variation and diverse camera perspectives), extracting stronger feature representation in person re-identification remains a challenging task. In this paper, we proposed a novel self-supervision and supervision combining transformer-based person re-identification framework, namely SSSC-TransReID. Different from the general transformer-based person re-identification models, we designed a self-supervised contrastive learning branch, which can enhance the feature representation for person re-identification without negative samples or additional pre-training. In order to train the contrastive learning branch, we also proposed a novel random rectangle mask strategy to simulate the occlusion in real scenes, so as to enhance the feature representation for occlusion. Finally, we utilized the joint-training loss function to integrate the advantages of supervised learning with ID tags and self-supervised contrastive learning without negative samples, which can reinforce the ability of our model to excavate stronger discriminative features, especially for occlusion. Extensive experimental results on several benchmark datasets show our proposed model obtains superior Re-ID performance consistently and outperforms the state-of-the-art ReID methods by large margins on the mean average accuracy (mAP) and Rank-1 accuracy.

行人重识别Transformer自监督学习遮挡处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。