用多摄像头与单摄像头数据混合训练,提升行人重识别泛化能力
ReMix: Training Generalized Person Re-identification on a Mixture of Data
- 联合训练多摄像头标注数据与大规模单摄像头无标注数据
- 在多个测试集上显著优于现有方法,跨场景识别更稳定
- 适合需要强泛化能力的监控与跨域行人检索场景
当前行人重识别(Re-ID)方法泛化能力弱,环境变化时性能大幅下降。主要因多摄像头Re-ID数据集规模小、多样性不足,而大量单摄像头未标注视频可轻松获取且更具多样性。现有方法仅用单摄像头数据做自监督预训练,后续微调时受限于少样本多摄像头数据,削弱了多样性优势。本文提出ReMix,通过新颖的数据采样策略与适配两类数据的损失函数,实现有限标注多摄像头数据与海量无标注单摄像头数据的联合训练。实验表明,ReMix具有更强泛化能力,在多个跨场景测试中超越现有最优方法。据我们所知,这是首个探索多摄像头与单摄像头数据混合训练的Re-ID工作。
原文摘要 · Abstract (English)
Modern person re-identification (Re-ID) methods have a weak generalization ability and experience a major accuracy drop when capturing environments change. This is because existing multi-camera Re-ID datasets are limited in size and diversity, since such data is difficult to obtain. At the same time, enormous volumes of unlabeled single-camera records are available. Such data can be easily collected, and therefore, it is more diverse. Currently, single-camera data is used only for self-supervised pre-training of Re-ID methods. However, the diversity of single-camera data is suppressed by fine-tuning on limited multi-camera data after pre-training. In this paper, we propose ReMix, a generalized Re-ID method jointly trained on a mixture of limited labeled multi-camera and large unlabeled single-camera data. Effective training of our method is achieved through a novel data sampling strategy and new loss functions that are adapted for joint use with both types of data. Experiments show that ReMix has a high generalization ability and outperforms state-of-the-art methods in generalizable person Re-ID. To the best of our knowledge, this is the first work that explores joint training on a mixture of multi-camera and single-camera data in person Re-ID.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。