arXiv:2411.00330cs.CV2024-11被引 17

通过多信息提示学习,提升换装后行人重识别准确率

Multiple Information Prompt Learning for Cloth-Changing Person Re-Identification

  • 设计多重提示机制,分离衣物特征并增强关键信息学习
  • 在多个数据集上达到74.8%~88.1%的rank-1准确率
  • 适合解决真实场景中衣物变化导致的身份识别难题

换装行人重识别更贴近现实应用,旨在解决行人更换衣物后的身份识别问题。核心挑战在于克服类内与类间外观变化的复杂交互,并提取不受服装变化影响的鲁棒特征。充足数据有助于缓解该问题,但实际采集多样化数据仍具挑战。现有方法多依赖图像隐式学习身份或引入辅助模型,受限于图像质量与辅助模型性能。为此,受提示学习启发,提出一种新型多信息提示学习(MIPL)框架,通过多源信息提示引导,学习身份不变特征。设计衣物信息剥离(CIS)模块,从原始RGB特征中解耦衣物信息以降低外观影响;提出生物引导注意力(BGA)模块,强化模型对关键区域的学习;采用双长度混合补丁(DHP)模块,提升特征覆盖多样性,减少特征偏差。大量实验表明,该方法在LTCC、Celeb-reID、Celeb-reID-light和CSCC数据集上均超越现有最优方法,分别取得74.8%、73.3%、66.0%和88.1%的rank-1准确率。相较于AIM(CVPR23)、ACID(TIP23)和SCNet(MM23),在PRCC数据集上分别提升11.3%、13.8%和7.9%。

原文摘要 · Abstract (English)

Cloth-changing person re-identification is a subject closer to the real world, which focuses on solving the problem of person re-identification after pedestrians change clothes. The primary challenge in this field is to overcome the complex interplay between intra-class and inter-class variations and to identify features that remain unaffected by changes in appearance. Sufficient data collection for model training would significantly aid in addressing this problem. However, it is challenging to gather diverse datasets in practice. Current methods focus on implicitly learning identity information from the original image or introducing additional auxiliary models, which are largely limited by the quality of the image and the performance of the additional model. To address these issues, inspired by prompt learning, we propose a novel multiple information prompt learning (MIPL) scheme for cloth-changing person ReID, which learns identity robust features through the common prompt guidance of multiple messages. Specifically, the clothing information stripping (CIS) module is designed to decouple the clothing information from the original RGB image features to counteract the influence of clothing appearance. The Bio-guided attention (BGA) module is proposed to increase the learning intensity of the model for key information. A dual-length hybrid patch (DHP) module is employed to make the features have diverse coverage to minimize the impact of feature bias. Extensive experiments demonstrate that the proposed method outperforms all state-of-the-art methods on the LTCC, Celeb-reID, Celeb-reID-light, and CSCC datasets, achieving rank-1 scores of 74.8%, 73.3%, 66.0%, and 88.1%, respectively. When compared to AIM (CVPR23), ACID (TIP23), and SCNet (MM23), MIPL achieves rank-1 improvements of 11.3%, 13.8%, and 7.9%, respectively, on the PRCC dataset.

行人重识别换装识别提示学习特征解耦

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。