arXiv:2504.09549cs.CV2025-04中稿 · IEEE TIP 2026被引 10

用生成模型统一建模俯视与地面视角,提升跨视角行人检索效果

SD-ReID: View-aware Stable Diffusion for Aerial-Ground Person Re-Identification

  • 基于ViT和可控条件训练生成模型,模拟多视角特征分布
  • 在5个基准上达到新最好结果,最高提升4.3% Rank-1精度
  • 适合需要跨视角行人识别的安防与无人机监控场景

空中-地面行人重识别(AG-ReID)旨在跨不同视角摄像头检索特定行人。现有方法侧重设计判别性模型以保持身份一致性,但忽视了视角特异性特征对表征能力的增强作用。为此,本文提出SD-ReID框架,利用生成模型模拟不同视角的特征分布,同时提取鲁棒的身份表征。首先训练基于ViT的模型,结合身份与视角等可控条件提取行人表征;随后微调Stable Diffusion模型,在这些条件引导下增强表征能力;进一步引入视图精修解码器(VRD),弥合实例级与全局级特征差距。最终联合使用行人表征与全视角特征进行检索。在五个基准数据集(CARGO、AG-ReIDv1、AG-ReIDv2、LAGPeR、G2APS-ReID)上的大量实验验证了该方法的有效性。代码与预训练模型已开源。

原文摘要 · Abstract (English)

Aerial-Ground Person Re-IDentification (AG-ReID) aims to retrieve specific persons across cameras with different viewpoints. Previous works focus on designing discriminative models to maintain the identity consistency despite drastic changes in camera viewpoints. The core idea behind these methods is quite natural, but designing a view-robust model is a very challenging task. Moreover, they overlook the contribution of view-specific features in enhancing the model's ability to represent persons. To address these issues, we propose a novel generative framework named SD-ReID for AG-ReID, which leverages generative models to mimic the feature distribution of different views while extracting robust identity representations. More specifically, we first train a ViT-based model to extract person representations along with controllable conditions, including identity and view conditions. We then fine-tune the Stable Diffusion (SD) model to enhance person representations guided by these controllable conditions. Furthermore, we introduce the View-Refined Decoder (VRD) to bridge the gap between instance-level and global-level features. Finally, both person representations and all-view features are employed to retrieve target persons. Extensive experiments on five AG-ReID benchmarks (i.e., CARGO, AG-ReIDv1, AG-ReIDv2, LAGPeR and G2APS-ReID) demonstrate the effectiveness of our proposed method. The source code and pre-trained models are available at https://github.com/924973292/SD-ReID.

行人重识别生成模型跨视角Stable Diffusion

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。