基于属性本体的语义级行人重识别系统,提升细粒度匹配准确率。
Person Re-Identification System at Semantic Level based on Pedestrian Attributes Ontology
- 构建行人属性本体,融合时尚与面部属性进行语义匹配
- 在Market1501上达到93.2%的Rank-1准确率,优于多数主流方法
- 无需修改网络结构或数据增强,有效缓解属性不平衡问题
行人重识别(Re-ID)是视频监控中追踪人员、公共场所寻人或分析超市顾客行为的重要任务。尽管已有大量研究,仍面临大规模数据集、数据不平衡、视角变化、细粒度属性等挑战,且局部特征未在在线阶段以语义层面利用,属性不平衡问题也未被充分考虑。本文提出统一的Re-ID系统,包含三个模块:行人属性本体(PAO)、局部多任务DCNN(Local MDCNN)和不平衡数据解决模块(IDS)。核心创新在于三者协同作用,利用属性内组相关性,并基于语义信息预筛选候选样本,显著提升匹配精度。实验在知名Market1501数据集上进行,结果表明该系统性能优于多个先进方法,实现93.2%的Rank-1准确率,且无需调整网络结构或使用数据增强即可缓解属性不平衡问题。
原文摘要 · Abstract (English)
Person Re-Identification (Re-ID) is a very important task in video surveillance systems such as tracking people, finding people in public places, or analysing customer behavior in supermarkets. Although there have been many works to solve this problem, there are still remaining challenges such as large-scale datasets, imbalanced data, viewpoint, fine grained data (attributes), the Local Features are not employed at semantic level in online stage of Re-ID task, furthermore, the imbalanced data problem of attributes are not taken into consideration. This paper has proposed a Unified Re-ID system consisted of three main modules such as Pedestrian Attribute Ontology (PAO), Local Multi-task DCNN (Local MDCNN), Imbalance Data Solver (IDS). The new main point of our Re-ID system is the power of mutual support of PAO, Local MDCNN and IDS to exploit the inner-group correlations of attributes and pre-filter the mismatch candidates from Gallery set based on semantic information as Fashion Attributes and Facial Attributes, to solve the imbalanced data of attributes without adjusting network architecture and data augmentation. We experimented on the well-known Market1501 dataset. The experimental results have shown the effectiveness of our Re-ID system and it could achieve the higher performance on Market1501 dataset in comparison to some state-of-the-art Re-ID methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。