用深度图+注意力机制实现隐私保护的行人重识别
Privacy-Preserving Person Re-Identification from Temporal Sequences with Transformer and Hungarian Optimization

- 用深度图像替代可见光图像,隐去人脸等敏感信息
- 结合匈牙利算法与时空序列Transformer,提升匹配精度
- 适合关注隐私安全的监控系统部署
行人重识别是监控与行为分析中的关键任务,常用于交通枢纽等公共场所。传统基于RGB的方法存在隐私泄露风险,且易受光照变化和遮挡影响。本文提出一种新方法,利用深度图像隐去面部等可识别特征,实现隐私保护。通过引入匈牙利算法优化多视角关联,最小化距离矩阵的全局代价。同时,采用包含时空帧序列的Transformer编码器,融合RGB与深度模态,捕捉动态运动模式,提升特征提取能力。进一步使用batch hard triplet loss增强对最难样本的判别学习。在多个俯视视角数据集(TVPR2、GODPR、BIWI RGBD-ID)上评估深度仅模型与RGB-D模型,结果表明:深度仅重识别在标准指标(CMC、mAP)上达到先进水平,同时兼顾隐私保护。
原文摘要 · Abstract (English)
Person re-identification (Re-ID) is a crucial task in surveillance and human behavior analysis, often used in public spaces such as transport hubs. Traditional RGB-based Re-ID methods raise privacy concerns and are highly sensitive to lighting variations and occlusion. In this paper, we propose a novel Re-ID approach that leverages depth images, which inherently obscures facial and other identifiable features, making it a privacy-preserving solution. Our method addresses the association problem between multiple views of individuals by applying the Hungarian algorithm, optimizing the matching process through minimization of the global cost across the distance matrix. We further enhance the approach by introducing temporal sequences of frames as input to a Transformer encoder architecture, which exploits both RGB and depth modalities. This architecture captures dynamic movement patterns, improving feature extraction and re-identification accuracy. Additionally, we employ batch hard triplet loss to enhance discriminative feature learning by focusing on the hardest samples. We evaluate both depth-only and RGB-D models on several top-view datasets, including TVPR2, GODPR, and BIWI RGBD-ID. Our results demonstrate that depth-only re-identification can achieve competitive performance compared to state-of-the-art methods, as measured by standard metrics such as Cumulative Matching Characteristics (CMC) and Mean Average Precision (mAP), while prioritizing privacy preservation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。