arXiv:2409.05277cs.CVcs.AI2024-09TPAMI被引 34

通过身份洗牌技术分离人物身份与非身份特征,提升跨视角、长时序重识别效果。

Disentangled Representations for Short-Term and Long-Term Person Re-Identification

  • 利用身份标签驱动的生成对抗网络,自动分离身份相关与无关特征
  • 在Market-1501等基准上达最新性能,长时序任务上显著超越现有方法
  • 无需额外标注即可实现特征解耦,适合无监督或弱监督场景

本文针对人物重识别(reID)问题,即根据查询图像从大规模数据集中检索目标人物图像。核心挑战在于学习对类内变化鲁棒的表征,因不同人物可能具有相同属性,而同一人物在不同视角下外观差异显著。现有方法多聚焦于对特定变化因素(如姿态)具备判别力的特征学习,但需相应标注信号。为此,本文提出将人物图像分解为身份相关与无关特征:前者包含识别特定人物的信息(如服装),后者包含其他因素(如姿态)。为此设计新型生成对抗网络——身份洗牌GAN(IS-GAN),仅使用身份标签完成特征解耦,无需辅助监督信号。通过约束无关特征分布或强制两类特征不相关,增强解耦效果。实验验证了IS-GAN的有效性,在Market-1501、CUHK03和DukeMTMC-reID等标准基准上达到当前最优性能。进一步在长时序reID任务中展示优势,在Celeb-reID数据集上刷新纪录。

原文摘要 · Abstract (English)

We address the problem of person re-identification (reID), that is, retrieving person images from a large dataset, given a query image of the person of interest. A key challenge is to learn person representations robust to intra-class variations, as different persons could have the same attribute, and persons' appearances look different, e.g., with viewpoint changes. Recent reID methods focus on learning person features discriminative only for a particular factor of variations (e.g., human pose), which also requires corresponding supervisory signals (e.g., pose annotations). To tackle this problem, we propose to factorize person images into identity-related and unrelated features. Identity-related features contain information useful for specifying a particular person (e.g., clothing), while identity-unrelated ones hold other factors (e.g., human pose). To this end, we propose a new generative adversarial network, dubbed identity shuffle GAN (IS-GAN). It disentangles identity-related and unrelated features from person images through an identity-shuffling technique that exploits identification labels alone without any auxiliary supervisory signals. We restrict the distribution of identity-unrelated features or encourage the identity-related and unrelated features to be uncorrelated, facilitating the disentanglement process. Experimental results validate the effectiveness of IS-GAN, showing state-of-the-art performance on standard reID benchmarks, including Market-1501, CUHK03, and DukeMTMC-reID. We further demonstrate the advantages of disentangling person representations on a long-term reID task, setting a new state of the art on a Celeb-reID dataset.

人物重识别特征解耦生成对抗网络长时序识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。