用文字属性组合提升跨摄像头物体识别的准确率与泛化能力
What Makes You Unique? Attribute Prompt Composition for Object Re-Identification
- 通过语义属性字典和动态组合模块生成个性化特征
- 在标准和域泛化数据集上均超越现有方法
- 适合需要跨场景识别的智能监控应用
目标重识别(ReID)旨在跨非重叠摄像头视角识别同一对象。尽管近期进展显著,但多数模型局限于单一领域或跨领域场景,限制了实际应用。单领域模型易过拟合特定域特征,而跨领域模型常依赖多样归一化策略,可能抑制身份判别线索。为此,我们提出属性提示组合(APC)框架,利用文本语义同时增强判别力与泛化性。具体地,设计属性提示生成器(APG),包含语义属性词典(SAD)与提示组合模块(PCM)。SAD提供丰富语义描述,PCM从SAD中自适应组合相关属性,生成判别性属性感知特征。此外,借鉴视觉-语言模型(VLM)强泛化能力,提出快慢训练策略(FSTS),通过快速更新流(FUS)快速获取ReID判别知识,慢速更新流(SUS)保留预训练VLM的通用知识。两者相互作用,有效聚焦于ReID相关特征并缓解过拟合。在常规与域泛化(DG)ReID数据集上的大量实验表明,该框架优于当前最优方法,在判别力与泛化性方面均有显著提升。代码已开源:https://github.com/AWangYQ/APC。
原文摘要 · Abstract (English)
Object Re-IDentification (ReID) aims to recognize individuals across non-overlapping camera views. While recent advances have achieved remarkable progress, most existing models are constrained to either single-domain or cross-domain scenarios, limiting their real-world applicability. Single-domain models tend to overfit to domain-specific features, whereas cross-domain models often rely on diverse normalization strategies that may inadvertently suppress identity-specific discriminative cues. To address these limitations, we propose an Attribute Prompt Composition (APC) framework, which exploits textual semantics to jointly enhance discrimination and generalization. Specifically, we design an Attribute Prompt Generator (APG) consisting of a Semantic Attribute Dictionary (SAD) and a Prompt Composition Module (PCM). SAD is an over-complete attribute dictionary to provide rich semantic descriptions, while PCM adaptively composes relevant attributes from SAD to generate discriminative attribute-aware features. In addition, motivated by the strong generalization ability of Vision-Language Models (VLM), we propose a Fast-Slow Training Strategy (FSTS) to balance ReID-specific discrimination and generalizable representation learning. Specifically, FSTS adopts a Fast Update Stream (FUS) to rapidly acquire ReID-specific discriminative knowledge and a Slow Update Stream (SUS) to retain the generalizable knowledge inherited from the pre-trained VLM. Through a mutual interaction, the framework effectively focuses on ReID-relevant features while mitigating overfitting. Extensive experiments on both conventional and Domain Generalized (DG) ReID datasets demonstrate that our framework surpasses state-of-the-art methods, exhibiting superior performances in terms of both discrimination and generalization. The source code is available at https://github.com/AWangYQ/APC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。