通过视觉文本对齐与提示机制,提升行人属性识别的准确性与鲁棒性。
ViTA-PAR: Visual and Textual Attribute Alignment with Attribute Prompting for Pedestrian Attribute Recognition
- 引入视觉属性提示,捕捉从全局到局部的语义特征。
- 设计可学习的文本提示模板,增强人物与属性上下文表征。
- 在四个基准上表现优异,适合复杂场景下的行人属性分析。
行人属性识别(PAR)旨在识别个体的多种细节属性,如服装、配饰和性别。为提升性能,模型需同时捕捉粗粒度全局属性(如性别)和细粒度局部特征(如配饰),这些特征可能出现在不同区域。现有方法虽利用身体部位表示提升鲁棒性,但通常局限于固定水平区域,当属性出现在变化或意外位置时性能下降。本文提出ViTA-PAR:基于属性提示的视觉与文本属性对齐方法,通过专用多模态提示与跨模态对齐,增强属性识别能力。引入视觉属性提示以捕获全局至局部语义;设计可学习的文本提示模板——人物与属性上下文提示,丰富文本嵌入;最后对齐视觉与文本属性特征实现有效融合。在四个PAR基准上验证,取得竞争力结果且推理高效。代码与模型已开源。
原文摘要 · Abstract (English)
The Pedestrian Attribute Recognition (PAR) task aims to identify various detailed attributes of an individual, such as clothing, accessories, and gender. To enhance PAR performance, a model must capture features ranging from coarse-grained global attributes (e.g., for identifying gender) to fine-grained local details (e.g., for recognizing accessories) that may appear in diverse regions. Recent research suggests that body part representation can enhance the model's robustness and accuracy, but these methods are often restricted to attribute classes within fixed horizontal regions, leading to degraded performance when attributes appear in varying or unexpected body locations. In this paper, we propose Visual and Textual Attribute Alignment with Attribute Prompting for Pedestrian Attribute Recognition, dubbed as ViTA-PAR, to enhance attribute recognition through specialized multimodal prompting and vision-language alignment. We introduce visual attribute prompts that capture global-to-local semantics, enabling diverse attribute representations. To enrich textual embeddings, we design a learnable prompt template, termed person and attribute context prompting, to learn person and attributes context. Finally, we align visual and textual attribute features for effective fusion. ViTA-PAR is validated on four PAR benchmarks, achieving competitive performance with efficient inference. We release our code and model at https://github.com/mlnjeongpark/ViTA-PAR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。