用双提示词和真实遮挡增强,提升被遮挡行人重识别准确率。
Dual-Prompt CLIP with Hybrid Visual Encoders for Occluded Person Re-Identification

- 设计双提示词策略,结合文本线索还原完整行人语义。
- 在CUHK-OCC、PRW等数据集上达到新最优,最高提升2.3% mAP。
- 适合处理复杂遮挡场景的行人识别系统开发者使用。
遮挡行人重识别旨在跨摄像头匹配部分可见的行人。然而,遮挡会破坏身体区域特征,增加跨视图匹配难度。现有基于预训练视觉-语言模型的方法多关注提示词引导特征学习,却忽视遮挡物的语义信息。受CLIP-ReID启发,我们提出一种新型双提示词学习重识别模型(DPL-ReID),包含双提示词学习(Dual-PL)策略,利用文本线索捕捉完整行人语义并保持对遮挡的鲁棒性;真实遮挡增强(RWOA)方法,真实模拟现实中的遮挡场景以丰富遮挡样本;以及加权门控特征融合(WGFF),引入LSNet捕获全局信息并作为特征门控机制,有效引导CLIP视觉编码器生成更全面的特征表示。在多个基准遮挡行人重识别数据集上的大量实验表明,所提DPL-ReID达到当前最优性能。遮挡实例库可于https://github.com/stone-qiao/DPL-ReID获取。
原文摘要 · Abstract (English)
Occluded person re-identification focuses on matching partially visible pedestrians across multiple camera views. However, occlusions disrupt body-region cues, thereby complicating cross-view matching. Most person ReID methods built on pretrained vision-language models only focus on enhancing prompt-based feature learning while ignoring the semantic information of occluders. Based on the success of CLIP-ReID, we propose a novel Dual Prompt Learning ReID (DPL-ReID) model for occluded person ReID. It incorporates a Dual Prompt Learning (Dual-PL) strategy, which can utilize textual cues to capture complete pedestrian semantics and keep robustness against occlusion, and a Real-World Occlusion Augmentation (RWOA) method that realistically simulates occlusion scenarios encountered in real word to enrich occluded samples. In addition, we also design a Weighted Gated Feature Fusion (WGFF) method, which in corporates LSNet to capture global information and act as a feature-gating mechanism. This mechanism can effectively guide the CLIP visual encoder toward generating more comprehensive feature representations. Extensive experiments on several benchmark occluded ReID datasets show that our proposed DPL-ReID achieves the state-of-the art performance. The occlusion instance library are available at https://github.com/stone-qiao/DPL-ReID.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。