利用预训练模型自动生成属性伪标签,提升遮挡下行人重识别效果
Attribute Guidance With Inherent Pseudo-label For Occluded Person Re-identification
- 通过两阶段流程生成细粒度属性伪标签,无需额外标注
- 在多个数据集上达到当前最优,显著改善遮挡和细微差异识别
- 适合关注遮挡场景或属性敏感任务的研究者
行人重识别(Re-ID)旨在跨摄像头匹配行人图像,其中遮挡场景下的重识别面临挑战。尽管预训练视觉-语言模型在常规任务中表现优异,但在遮挡情况下因过度关注整体语义而忽略细粒度属性信息,导致对部分遮挡行人或外观差异微小的个体区分能力下降。为此,本文提出属性引导重识别框架AG-ReID,充分利用预训练模型自身能力,在不依赖额外数据或标注的前提下生成细粒度属性伪标签。该框架采用两阶段设计:首先生成捕捉细微视觉特征的属性伪标签,再引入全貌与细粒度属性双重引导机制,增强图像特征提取。大量实验表明,AG-ReID在多个主流Re-ID数据集上均取得当前最优性能,显著提升对遮挡及细微属性差异的处理能力,同时在标准场景下保持竞争力。
原文摘要 · Abstract (English)
Person re-identification (Re-ID) aims to match person images across different camera views, with occluded Re-ID addressing scenarios where pedestrians are partially visible. While pre-trained vision-language models have shown effectiveness in Re-ID tasks, they face significant challenges in occluded scenarios by focusing on holistic image semantics while neglecting fine-grained attribute information. This limitation becomes particularly evident when dealing with partially occluded pedestrians or when distinguishing between individuals with subtle appearance differences. To address this limitation, we propose Attribute-Guide ReID (AG-ReID), a novel framework that leverages pre-trained models' inherent capabilities to extract fine-grained semantic attributes without additional data or annotations. Our framework operates through a two-stage process: first generating attribute pseudo-labels that capture subtle visual characteristics, then introducing a dual-guidance mechanism that combines holistic and fine-grained attribute information to enhance image feature extraction. Extensive experiments demonstrate that AG-ReID achieves state-of-the-art results on multiple widely-used Re-ID datasets, showing significant improvements in handling occlusions and subtle attribute differences while maintaining competitive performance on standard Re-ID scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。