通过挖掘特定模态的隐含身份线索,提升可见光与红外行人重识别性能。
Identity Clue Refinement and Enhancement for Visible-Infrared Person Re-Identification
- 设计多感知特征精炼模块,捕捉易被忽略的模态特有属性。
- 提出语义蒸馏级联增强模块,提炼身份相关知识并指导特征学习。
- 适用于跨模态行人重识别任务,尤其对弱监督场景有显著提升。
可见光-红外行人重识别(VI-ReID)因模态差异大而极具挑战性。现有方法主要聚焦于通过统一嵌入空间学习模态不变特征,但通常仅关注跨模态的共性判别语义,忽视了模态特有身份感知知识在判别特征学习中的关键作用。为此,本文提出身份线索精炼与增强(ICRE)网络,旨在挖掘并利用模态特有属性中蕴含的隐含判别知识。首先,设计多感知特征精炼(MPFR)模块,聚合共享分支的浅层特征,以捕获易被忽略的模态特有属性;其次,提出语义蒸馏级联增强(SDCE)模块,从聚合的浅层特征中蒸馏身份感知知识,并引导模态不变特征的学习;最后,设计身份线索引导(ICG)损失,缓解增强特征中的模态差异,促进多样化表示空间的学习。在多个公开数据集上的大量实验表明,所提ICRE方法显著优于当前最先进方法。
原文摘要 · Abstract (English)
Visible-Infrared Person Re-Identification (VI-ReID) is a challenging cross-modal matching task due to significant modality discrepancies. While current methods mainly focus on learning modality-invariant features through unified embedding spaces, they often focus solely on the common discriminative semantics across modalities while disregarding the critical role of modality-specific identity-aware knowledge in discriminative feature learning. To bridge this gap, we propose a novel Identity Clue Refinement and Enhancement (ICRE) network to mine and utilize the implicit discriminative knowledge inherent in modality-specific attributes. Initially, we design a Multi-Perception Feature Refinement (MPFR) module that aggregates shallow features from shared branches, aiming to capture modality-specific attributes that are easily overlooked. Then, we propose a Semantic Distillation Cascade Enhancement (SDCE) module, which distills identity-aware knowledge from the aggregated shallow features and guide the learning of modality-invariant features. Finally, an Identity Clues Guided (ICG) Loss is proposed to alleviate the modality discrepancies within the enhanced features and promote the learning of a diverse representation space. Extensive experiments across multiple public datasets clearly show that our proposed ICRE outperforms existing SOTA methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。