通过跨视频身份关联提升行人重识别预训练效果
Cross-video Identity Correlating for Person Re-identification Pre-training

- 将跨视频身份关联建模为渐进式多层级去噪问题
- 仅用8%样本即达93.3% mAP(Market1501)和74.3% mAP(MSMT17)
- 提供32个模型的ReIDZoo,支持多种结构与应用需求
近期研究表明,在互联网视频中提取的大规模行人图像上进行预训练,可有效学习更好的行人重识别表征。然而,现有方法多局限于实例级或单视频轨迹级预训练,忽略了同一人在不同视频中的身份一致性这一关键特性。为此,本文提出跨视频身份关联预训练框架CION,定义一个综合考虑类内一致性和类间区分性的噪声概念,将身份关联建模为渐进式多层级去噪问题。此外,提出一种身份引导的自蒸馏损失,以挖掘行人图像中的身份不变性,实现更优的大规模预训练。大量实验证明,CION在效率和性能上均具优势:例如,使用相同ResNet50-IBN架构时,相比先前最优方法ISR,CION在Market1501上达到93.3% mAP、MSMT17上达到74.3% mAP,且仅需8%训练样本。最后,鉴于其优异的模型无关性,本文构建了名为ReIDZoo的模型库,包含32个预训练模型,涵盖GhostNet、ConvNeXt、RepViT、FastViT等10种结构。代码与模型将公开于https://github.com/Zplusdragon/CION_ReIDZoo。
原文摘要 · Abstract (English)
Recent researches have proven that pre-training on large-scale person images extracted from internet videos is an effective way in learning better representations for person re-identification. However, these researches are mostly confined to pre-training at the instance-level or single-video tracklet-level. They ignore the identity-invariance in images of the same person across different videos, which is a key focus in person re-identification. To address this issue, we propose a Cross-video Identity-cOrrelating pre-traiNing (CION) framework. Defining a noise concept that comprehensively considers both intra-identity consistency and inter-identity discrimination, CION seeks the identity correlation from cross-video images by modeling it as a progressive multi-level denoising problem. Furthermore, an identity-guided self-distillation loss is proposed to implement better large-scale pre-training by mining the identity-invariance within person images. We conduct extensive experiments to verify the superiority of our CION in terms of efficiency and performance. CION achieves significantly leading performance with even fewer training samples. For example, compared with the previous state-of-the-art~\cite{ISR}, CION with the same ResNet50-IBN achieves higher mAP of 93.3\% and 74.3\% on Market1501 and MSMT17, while only utilizing 8\% training samples. Finally, with CION demonstrating superior model-agnostic ability, we contribute a model zoo named ReIDZoo to meet diverse research and application needs in this field. It contains a series of CION pre-trained models with spanning structures and parameters, totaling 32 models with 10 different structures, including GhostNet, ConvNext, RepViT, FastViT and so on. The code and models will be made publicly available at https://github.com/Zplusdragon/CION_ReIDZoo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。