通过自校准提示提升航地视角下行人重识别效果
SeCap: Self-Calibrating and Adaptive Prompts for Cross-view Person Re-Identification in Aerial-Ground Networks
- 设计自校准提示模块,动态调整输入特征以适应不同视角
- 在两个新数据集上实现超过90%的mAP,显著优于现有方法
- 适合关注跨视角行人识别与视觉提示优化的研究者
航地行人重识别(AGPReID)面临因视角差异导致的外观变化难题。现有方法虽尝试通过关键属性建模和视角解耦缓解问题,但仍存在难以应对视角多样性、忽略局部特征贡献的缺陷。为此,本文提出自校准自适应提示(SeCap)框架,核心为提示再校准模块(PRM),可基于输入动态调整提示;结合局部特征精炼模块(LFRM),从局部特征中提取视角不变表示。此外,针对当前数据集匮乏,构建了两个真实世界大规模航地行人重识别数据集:LAGPeR(含4,231个唯一身份、63,841张高质量图像)和G2APS-ReID(由G2APS重构)。在多个数据集上的大量实验表明,SeCap在航地行人重识别任务中具有可行性与有效性。代码与数据集已开源。
原文摘要 · Abstract (English)
When discussing the Aerial-Ground Person Re-identification (AGPReID) task, we face the main challenge of the significant appearance variations caused by different viewpoints, making identity matching difficult. To address this issue, previous methods attempt to reduce the differences between viewpoints by critical attributes and decoupling the viewpoints. While these methods can mitigate viewpoint differences to some extent, they still face two main issues: (1) difficulty in handling viewpoint diversity and (2) neglect of the contribution of local features. To effectively address these challenges, we design and implement the Self-Calibrating and Adaptive Prompt (SeCap) method for the AGPReID task. The core of this framework relies on the Prompt Re-calibration Module (PRM), which adaptively re-calibrates prompts based on the input. Combined with the Local Feature Refinement Module (LFRM), SeCap can extract view-invariant features from local features for AGPReID. Meanwhile, given the current scarcity of datasets in the AGPReID field, we further contribute two real-world Large-scale Aerial-Ground Person Re-Identification datasets, LAGPeR and G2APS-ReID. The former is collected and annotated by us independently, covering $4,231$ unique identities and containing $63,841$ high-quality images; the latter is reconstructed from the person search dataset G2APS. Through extensive experiments on AGPReID datasets, we demonstrate that SeCap is a feasible and effective solution for the AGPReID task. The datasets and source code available on https://github.com/wangshining681/SeCap-AGPReID.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。