用可控合成数据提升衣物变化下行人重识别的泛化能力
CCUP: A Controllable Synthetic Data Generation Pipeline for Pretraining Cloth-Changing Person Re-Identification Models
- 构建可控制的合成数据流水线,模拟真实监控场景
- 生成含6000人、118万图、26.5套服饰的大型数据集CCUP
- 新框架使模型在多个基准上超越现有最优结果
衣物变化行人重识别(CC-ReID),又称长时行人重识别(LT-ReID),是计算机视觉中的关键挑战。由于真实数据构建成本高,现有数据驱动模型在有限数据上训练易过拟合。为此,我们提出一种低成本高效的合成数据生成流水线,模拟真实监控场景下的CC-ReID任务。特别地,我们构建了名为Cloth-Changing Unreal Person(CCUP)的新自标注数据集,包含6,000个身份、1,179,976张图像、100个摄像头和每人平均26.5套服饰。基于该大规模数据集,我们设计了一种有效且可扩展的预训练-微调框架,显著提升传统CC-ReID模型的泛化能力。大量实验表明,将TransReID和FIRe^2模型在CCUP上预训练并微调至PRCC、VC-Clothes和NKUP等基准后,性能优于其他先进方法。数据集已公开于:https://github.com/yjzhao1019/CCUP。
原文摘要 · Abstract (English)
Cloth-changing person re-identification (CC-ReID), also known as Long-Term Person Re-Identification (LT-ReID) is a critical and challenging research topic in computer vision that has recently garnered significant attention. However, due to the high cost of constructing CC-ReID data, the existing data-driven models are hard to train efficiently on limited data, causing overfitting issue. To address this challenge, we propose a low-cost and efficient pipeline for generating controllable and high-quality synthetic data simulating the surveillance of real scenarios specific to the CC-ReID task. Particularly, we construct a new self-annotated CC-ReID dataset named Cloth-Changing Unreal Person (CCUP), containing 6,000 IDs, 1,179,976 images, 100 cameras, and 26.5 outfits per individual. Based on this large-scale dataset, we introduce an effective and scalable pretrain-finetune framework for enhancing the generalization capabilities of the traditional CC-ReID models. The extensive experiments demonstrate that two typical models namely TransReID and FIRe^2, when integrated into our framework, outperform other state-of-the-art models after pretraining on CCUP and finetuning on the benchmarks such as PRCC, VC-Clothes and NKUP. The CCUP is available at: https://github.com/yjzhao1019/CCUP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。