通过强化学习净化特征,提升遮挡下行人重识别精度。
Occlusion-Guided Feature Purification Learning via Reinforced Knowledge Distillation for Occluded Person Re-Identification
- 用注意力机制显式建模多样遮挡模式,引导特征学习。
- 引入强化学习代理识别并替换低质图像块,避免噪声污染。
- 教师-学生蒸馏传递纯净全局知识,适合复杂遮挡场景应用。
遮挡行人重识别旨在基于部分遮挡图像检索完整图像。现有方法依赖可见身体部位对齐、遮挡增强或利用完整图像补充缺失语义,但难以应对训练中未见的多样化遮挡情况,且易受完整图像带来的特征污染影响。为此,提出基于强化知识蒸馏的遮挡引导特征净化学习(OGFR),采用教师-学生架构,在融合多样遮挡模式的同时,通过强化知识蒸馏将纯净的判别性全局知识从完整分支传递至遮挡分支。具体地,设计了遮挡感知视觉变换器,利用可学习的遮挡模式嵌入显式建模不同遮挡类型,以指导鲁棒特征表示;在完整分支中引入特征擦除与净化模块,通过深度强化学习代理识别包含噪声负信息的低质量图像块,并用可学习嵌入块替代,避免特征污染并进一步挖掘身份相关判别线索。最终,借助知识蒸馏,学生分支能有效吸收净化后的全局知识,从而在遮挡干扰下精确学习鲁棒表示。
原文摘要 · Abstract (English)
Occluded person re-identification aims to retrieve holistic images based on occluded ones. Existing methods often rely on aligning visible body parts, applying occlusion augmentation, or complementing missing semantics using holistic images. However, they face challenges in handling diverse occlusion scenarios not seen during training and the issue of feature contamination from holistic images. To address these limitations, we propose Occlusion-Guided Feature Purification Learning via Reinforced Knowledge Distillation (OGFR), which simultaneously mitigates these challenges. OGFR adopts a teacher-student distillation architecture that effectively incorporates diverse occlusion patterns into feature representation while transferring the purified discriminative holistic knowledge from the holistic to the occluded branch through reinforced knowledge distillation. Specifically, an Occlusion-Aware Vision Transformer is designed to leverage learnable occlusion pattern embeddings to explicitly model such diverse occlusion types, thereby guiding occlusion-aware robust feature representation. Moreover, we devise a Feature Erasing and Purification Module within the holistic branch, in which an agent is employed to identify low-quality patch tokens of holistic images that contain noisy negative information via deep reinforcement learning, and substitute these patch tokens with learnable embedding tokens to avoid feature contamination and further excavate identity-related discriminative clues. Afterward, with the assistance of knowledge distillation, the student branch effectively absorbs the purified holistic knowledge to precisely learn robust representation regardless of the interference of occlusions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。