arXiv:2412.01048cs.CV2024-12被引 9

用语义标签提升行人重识别,区分同属性不同人

Cerberus: Attribute-based person re-identification using semantic IDs

  • 用属性组合生成语义ID,指导特征学习
  • 在Market-1501和DukeMTMC上超越现有方法
  • 可同时完成属性识别与基于属性的搜索

我们提出Cerberus框架,用于基于属性的行人重识别(reID)。该方法利用行人属性标签学习局部与全局表征,编码性别、着装风格等具体特征。通过将属性标签组合成语义ID(SID),并引入语义引导损失,使表征与对应SID原型特征对齐,强化语义编码。同时,强制同一人的表征紧密嵌入,以区分具有相同属性标签的不同个体。为提升未见数据泛化能力,还提出利用SID原型间关系的正则化方法。框架在查询与图库图像间分别比较局部与全局表征,借助对齐的SID原型,无需额外组件即可实现属性识别(PAR)与基于属性的行人搜索(APS)。在标准基准Market-1501与DukeMTMC上的实验表明,该模型优于现有最先进方法。

原文摘要 · Abstract (English)

We introduce a new framework, dubbed Cerberus, for attribute-based person re-identification (reID). Our approach leverages person attribute labels to learn local and global person representations that encode specific traits, such as gender and clothing style. To achieve this, we define semantic IDs (SIDs) by combining attribute labels, and use a semantic guidance loss to align the person representations with the prototypical features of corresponding SIDs, encouraging the representations to encode the relevant semantics. Simultaneously, we enforce the representations of the same person to be embedded closely, enabling recognizing subtle differences in appearance to discriminate persons sharing the same attribute labels. To increase the generalization ability on unseen data, we also propose a regularization method that takes advantage of the relationships between SID prototypes. Our framework performs individual comparisons of local and global person representations between query and gallery images for attribute-based reID. By exploiting the SID prototypes aligned with the corresponding representations, it can also perform person attribute recognition (PAR) and attribute-based person search (APS) without bells and whistles. Experimental results on standard benchmarks on attribute-based person reID, Market-1501 and DukeMTMC, demonstrate the superiority of our model compared to the state of the art.

行人重识别属性识别语义表征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。