提出FOCUS方法,让行人属性识别更精准且能预测未见属性。
FOCUS: Fine-grained Optimization with Semantic Guided Understanding for Pedestrian Attributes Recognition
- 为每个属性独立提取细粒度特征,不依赖固定区域
- 在三个数据集上准确率显著超越现有方法,泛化能力强
- 适合需要灵活识别新属性的智能安防场景
行人属性识别(PAR)是智能交通与安全领域的基础感知任务。现有方法多聚焦于提取区域特征以丰富属性信息,但通常将区域特征用于预定义属性的固定预测,存在两方面局限:1)区域特征可能牺牲特定属性的独特细粒度模式,以捕捉跨属性的共性特征;2)无法泛化至测试时未见属性。本文提出细粒度优化与语义引导理解框架(FOCUS),可为每个属性自适应地提取属性级特征,无论其是否在训练中出现。我们设计多粒度混合令牌(MGMT)以捕获不同视觉粒度的潜在特征,提升信息多样性。进一步提出属性引导视觉特征提取(AVFE)模块,利用文本属性作为查询,通过交叉注意力从混合令牌中检索对应视觉特征。为确保文本属性关注正确令牌,引入区域感知对比学习(RACL),促使同一区域内的属性共享一致注意力图。在PA100K、PETA和RAPv1数据集上的大量实验表明,该方法有效且具备强大泛化能力。
原文摘要 · Abstract (English)
Pedestrian attribute recognition (PAR) is a fundamental perception task in intelligent transportation and security. To tackle this fine-grained task, most existing methods focus on extracting regional features to enrich attribute information. However, a regional feature is typically used to predict a fixed set of pre-defined attributes in these methods, which limits the performance and practicality in two aspects: 1) Regional features may compromise fine-grained patterns unique to certain attributes in favor of capturing common characteristics shared across attributes. 2) Regional features cannot generalize to predict unseen attributes in the test time. In this paper, we propose the \textbf{F}ine-grained \textbf{O}ptimization with semanti\textbf{C} g\textbf{U}ided under\textbf{S}tanding (FOCUS) approach for PAR, which adaptively extracts fine-grained attribute-level features for each attribute individually, regardless of whether the attributes are seen or not during training. Specifically, we propose the Multi-Granularity Mix Tokens (MGMT) to capture latent features at varying levels of visual granularity, thereby enriching the diversity of the extracted information. Next, we introduce the Attribute-guided Visual Feature Extraction (AVFE) module, which leverages textual attributes as queries to retrieve their corresponding visual attribute features from the Mix Tokens using a cross-attention mechanism. To ensure that textual attributes focus on the appropriate Mix Tokens, we further incorporate a Region-Aware Contrastive Learning (RACL) method, encouraging attributes within the same region to share consistent attention maps. Extensive experiments on PA100K, PETA, and RAPv1 datasets demonstrate the effectiveness and strong generalization ability of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。