arXiv:2604.22190cs.CVcs.AI2026-04

用局部特征重构身份表示,提升遮挡下的行人重识别准确率

From Global to Local: Rethinking CLIP Feature Aggregation for Person Re-Identification

论文配图:From Global to Local: Rethinking CLIP Feature Aggregation for Person Re-Identification
图 1 · 摘自论文原文
  • 通过锚点向量对齐中间图像块,实现空间稳定特征聚合
  • 在遮挡场景下最高提升10.6% Rank-1准确率,优于全局池化
  • 无需图像描述即可工作,适合真实复杂环境中的行人识别

基于CLIP的行人重识别方法将空间特征聚合为单一全局[CLS] token,该设计虽优化了图文对齐,却牺牲了空间选择性,导致在遮挡和跨摄像头变化下表现脆弱。本文提出SAGA-ReID,通过将中间图像块与参数化于CLIP文本嵌入空间的锚点向量对齐,重建身份表征,强调空间稳定的证据并抑制受损或缺失区域。控制实验在两种条件下验证:合成掩码(身份信号缺失)和真实人类干扰(语义混淆信号),结果显示随遮挡程度增加,SAGA优势显著提升。基准测试表明,在标准和遮挡设置下均持续优于CLIP-ReID,尤其在全局池化失效时提升最大达+10.6 Rank-1。即使在更强骨干网络上,其结构化重建仍优于专用序列特征聚合,证实该方法解决了仅靠骨干质量与架构复杂度无法突破的瓶颈。代码已开源。

原文摘要 · Abstract (English)

CLIP-based person re-identification (ReID) methods aggregate spatial features into a single global \texttt{[CLS]} token optimized for image-text alignment rather than spatial selectivity, making representations fragile under occlusion and cross-camera variation. We propose SAGA-ReID, which reconstructs identity representations by aligning intermediate patch tokens with anchor vectors parameterized in CLIP's text embedding space -- emphasizing spatially stable evidence while suppressing corrupted or absent regions, without requiring textual descriptions of individual images. Controlled experiments isolate the aggregation mechanism under two qualitatively distinct conditions -- synthetic masking, where identity signal is absent, and realistic human distractors, where an overlapping person introduces semantically confusing signal -- with SAGA's advantage over global pooling growing substantially as occlusion increases across both conditions. Benchmark evaluations confirm consistent gains over CLIP-ReID across standard and occluded settings, with the largest improvements where global pooling is most unreliable: up to +10.6 Rank-1 on occluded benchmarks. SAGA's aggregation outperforms dedicated sequential patch aggregation on a stronger backbone, confirming that structured reconstruction addresses a bottleneck that backbone quality and architectural complexity alone cannot resolve. Code available at https://github.com/ipl-uw/Structured-Anchor-Guided-Aggregation-for-ReID.

行人重识别特征聚合遮挡鲁棒CLIP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。