用文字描述分离穿衣变化下的身份特征,提升识别准确率。
DIFFER: Disentangling Identity Features via Semantic Cues for Clothes-Changing Person Re-ID
- 通过文本描述引导,用对抗学习分离身份与非生物特征
- 在4个数据集上最高提升3.6%准确率,全场景领先
- 适合关注跨服装身份识别的视觉算法研究者
穿衣变化下的人体重识别(CC-ReID)旨在识别不同着装条件下的个体。现有方法或依赖轮廓、姿态等额外模态建模体态,可能忽略性别、年龄、风格等关键生物特征;或引入衣物、属性等离散标签作为监督,但这些标签无法全面描述。本文提出DIFFER:一种基于文本描述的对抗性特征解耦方法,利用文本的可分割性作为监督信号,设计NBDetach机制将特征空间划分为独立子空间,通过梯度反转层有效分离身份相关特征与非生物特征。在LTCC、PRCC、CelebreID-Light和CCVID共4个基准数据集上验证,显著优于基线模型,顶1准确率分别提升3.6%、3.4%、2.5%和1%。
原文摘要 · Abstract (English)
Clothes-changing person re-identification (CC-ReID) aims to recognize individuals under different clothing scenarios. Current CC-ReID approaches either concentrate on modeling body shape using additional modalities including silhouette, pose, and body mesh, potentially causing the model to overlook other critical biometric traits such as gender, age, and style, or they incorporate supervision through additional labels that the model tries to disregard or emphasize, such as clothing or personal attributes. However, these annotations are discrete in nature and do not capture comprehensive descriptions. In this work, we propose DIFFER: Disentangle Identity Features From Entangled Representations, a novel adversarial learning method that leverages textual descriptions to disentangle identity features. Recognizing that image features inherently mix inseparable information, DIFFER introduces NBDetach, a mechanism designed for feature disentanglement by leveraging the separable nature of text descriptions as supervision. It partitions the feature space into distinct subspaces and, through gradient reversal layers, effectively separates identity-related features from non-biometric features. We evaluate DIFFER on 4 different benchmark datasets (LTCC, PRCC, CelebreID-Light, and CCVID) to demonstrate its effectiveness and provide state-of-the-art performance across all the benchmarks. DIFFER consistently outperforms the baseline method, with improvements in top-1 accuracy of 3.6% on LTCC, 3.4% on PRCC, 2.5% on CelebReID-Light, and 1% on CCVID. Our code can be found here.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。