一个模型搞定多种行人属性识别任务,跨场景更稳定。
UniPAR: A Unified Framework for Pedestrian Attribute Recognition
- 用统一的Transformer框架处理图片、视频、事件流数据
- 多数据集联合训练使识别在弱光模糊下仍保持高精度
- 适合需要跨域泛化能力的监控与零售场景
行人属性识别是视频监控和智能零售等应用的关键任务。现有方法多采用“一数据集一模型”模式,难以应对模态、属性定义及环境差异带来的挑战。为此,我们提出UniPAR,一种基于Transformer的统一框架。通过统一数据调度策略和动态分类头,UniPAR可同时处理来自不同模态(如RGB图像、视频序列、事件流)的异构数据集。我们还设计了一种分阶段融合编码器,通过后期深度融合策略,显式对齐视觉特征与文本属性查询。在MSP60K、DukeMTMC和EventPAR等主流基准上的实验表明,UniPAR性能媲美专用的最先进方法。多数据集联合训练显著提升了模型在低光照和运动模糊等极端环境下的跨域泛化能力与鲁棒性。代码将开源于https://github.com/Event-AHU/OpenPAR。
原文摘要 · Abstract (English)
Pedestrian Attribute Recognition is a foundational computer vision task that provides essential support for downstream applications, including person retrieval in video surveillance and intelligent retail analytics. However, existing research is frequently constrained by the ``one-model-per-dataset" paradigm and struggles to handle significant discrepancies across domains in terms of modalities, attribute definitions, and environmental scenarios. To address these challenges, we propose UniPAR, a unified Transformer-based framework for PAR. By incorporating a unified data scheduling strategy and a dynamic classification head, UniPAR enables a single model to simultaneously process diverse datasets from heterogeneous modalities, including RGB images, video sequences, and event streams. We also introduce an innovative phased fusion encoder that explicitly aligns visual features with textual attribute queries through a late deep fusion strategy. Experimental results on the widely used benchmark datasets, including MSP60K, DukeMTMC, and EventPAR, demonstrate that UniPAR achieves performance comparable to specialized SOTA methods. Furthermore, multi-dataset joint training significantly enhances the model's cross-domain generalization and recognition robustness in extreme environments characterized by low light and motion blur. The source code of this paper will be released on https://github.com/Event-AHU/OpenPAR
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。