动态遮挡下学习可靠身份特征,提升行人重识别准确率
DPM++: Dynamic Masked Metric Learning for Occluded Person Re-identification

- 根据输入自适应选择可靠身份子空间,动态屏蔽不可靠区域
- 在Occluded-REID数据集上达到86.3% mAP,优于现有方法
- 适合真实场景中遮挡严重的行人识别任务
尽管行人重识别已取得显著进展,但障碍物导致的遮挡仍是实际应用中的未解难题。困难在于不完整遮挡样本与整体身份表征之间的不匹配。严重遮挡会移除关键身体特征,并引入背景杂乱和遮挡物干扰,使全局度量学习不可靠。现有方法多依赖预训练模型估计可见区域进行对齐,或通过数据增强构造遮挡样本,但仍缺乏统一框架来学习现实遮挡模式下的鲁棒可见性一致性匹配。本文提出DPM++,一种动态遮挡度量学习框架,可为每个遮挡实例动态选择可靠的身份子空间,使匹配聚焦于可见性一致证据并抑制不可靠成分。基于分类器原型空间,DPM++引入基于CLIP的两阶段监督机制,从文本分支学习身份级语义先验并传递至分类器原型空间以实现动态遮挡匹配。为强化遮挡度量,引入显著性引导的块迁移策略,在训练中合成可控且逼真的遮挡样本。利用真实场景先验,该策略使模型暴露于真实部分观测,提供比随机擦除更丰富的监督。此外,遮挡感知样本配对与掩码引导优化提升了框架的稳定性和有效性。在遮挡与完整行人重识别基准上的实验表明,DPM++在完整与遮挡场景下均持续超越此前最先进方法。
原文摘要 · Abstract (English)
Although person re-identification has made impressive progress, occlusion caused by obstacles remains an unsettled issue in real applications. The difficulty lies in the mismatch between incomplete occluded samples and holistic identity representations. Severe occlusion removes discriminative body cues and introduces interference from background clutter and occluders, making global metric learning unreliable. Existing methods mainly rely on extra pre-trained models to estimate visible parts for alignment or construct occluded samples via data augmentation, but still lack a unified framework that learns robust visibility-consistent matching under realistic occlusion patterns. In this paper, we propose DPM++, a Dynamic Masked Metric Learning framework for occluded person re-identification. DPM++ learns an input-adaptive masked metric that dynamically selects reliable identity subspaces for each occluded instance, enabling matching to emphasize visibility-consistent evidence while suppressing unreliable components. Built upon the classifier-prototype space, DPM++ introduces a CLIP-based two-stage supervision scheme, where ID-level semantic priors are learned from the text branch and transferred into the classifier-prototype space for dynamic masked matching. To strengthen the masked metric, we introduce a saliency-guided patch transfer strategy to synthesize controllable and photo-realistic occluded samples during training. Exploiting real scene priors, this strategy exposes the model to realistic partial observations and provides richer supervision than random erasing. In addition, occlusion-aware sample pairing and mask-guided optimization improve the stability and effectiveness of the framework. Experiments on occluded and holistic person re-identification benchmarks show that DPM++ consistently outperforms previous state-of-the-art methods in both holistic and occlusion scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。