让系统通过罕见特征精准找人,提升监控视频检索效率。
Open-Attribute Person Retrieval: Finding People Through Distinctive and Novel Attributes
- 构建新任务OAPR,支持检索任意属性(含未见概念)
- 在EPAD数据集上,对冷门属性检索准确率超现有方法
- 适合安防、智能监控等需快速定位特殊行为的场景
监控视频中的人物检索常依赖目击者描述的属性。实践中最有用的并非常见特征(如性别、衣服颜色),而是罕见且显著的属性(如持武器、趴地),这些能大幅缩小搜索范围。现有基于文本的人体检索基准和方法主要聚焦于身份相关检索,忽视了这类关键属性。本文提出开放属性人物检索(OAPR),旨在检索所有匹配给定属性查询的行人实例,包括罕见或未见过的视觉概念,与身份无关。为此,我们构建了包含267,885张行人图像的扩展行人属性数据集EPAD,涵盖65个统一属性,涵盖安全关键动作、辅助设备及物体交互等以往少见内容。进一步提出GAP-CLIP框架,一种轻量级基于CLIP的模型,通过门控机制学习属性感知的身体部位表示。在EPAD上的大量实验表明,GAP-CLIP在全属性空间及分布外属性上均达到最优的top-K检索性能。代码与数据集已公开于https://github.com/mlnjeongpark/Open-Attribute-Person-Retrieval。
原文摘要 · Abstract (English)
Person retrieval in surveillance videos often depends on attributes described by witnesses or operators. However, the most useful cues in practice are not always common appearance descriptions (e.g., gender, clothing color), but rare and distinctive attributes that can sharply reduce the search space (e.g., holding a weapon, lying on the ground). Existing text-based person retrieval benchmarks and methods largely focus on identity-centric retrieval with common pedestrian descriptions, leaving such retrieval-critical attributes underexplored. In this paper, we introduce Open-Attribute Person Retrieval (OAPR), a practical retrieval setting that aims to retrieve all pedestrian instances matching a given attribute query, including rare or previously unseen visual concepts, regardless of identity. To support this task, we construct EPAD, an Expanded Pedestrian Attribute Dataset with 267,885 pedestrian images and a unified vocabulary of 65 attributes, including safety-critical actions, assistive devices, and object interactions that are rarely covered in prior benchmarks. We further propose GAP-CLIP, a lightweight CLIP-based framework that learns gated attribute-aware body-part representations for OAPR. Extensive experiments on EPAD demonstrate that GAP-CLIP achieves the strongest top-K retrieval performance on the full attribute space and on out-of-distribution attributes. The code and dataset are available at https://github.com/mlnjeongpark/Open-Attribute-Person-Retrieval.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。