arXiv:2507.17995cs.CV2025-07中稿 · IEEE International…被引 3

首个空地跨视角可见光红外视频行人重识别数据集,解决夜间监控难题。

AG-VPReID.VIR: Bridging Aerial and Ground Platforms for Video-based Visible-Infrared Person Re-ID

  • 设计三流网络,融合空地视角与可见光红外模态特征
  • 在1837人、4861轨迹上实现跨平台重识别性能提升
  • 适合智能安防、无人机巡检等需要全天候监控的场景

可见光与红外模态的行人重识别对全天候监控系统至关重要,但现有数据集多聚焦地面视角。地面红外系统虽能夜间工作,却面临遮挡、覆盖范围有限和易受阻碍等问题,而空中视角可有效缓解这些缺陷。为此,我们提出AG-VPReID.VIR,首个面向空地跨模态视频行人重识别的数据集。该数据集通过无人机搭载与固定摄像头同步采集,涵盖1,837个身份、4,861条轨迹(共124,855帧),覆盖RGB与红外双模态。数据集面临跨视角差异、模态不一致及时间动态变化等挑战。同时,我们提出TCC-VPReID,一种新型三流架构,通过鲁棒风格特征学习、基于记忆的跨视图适应和中介引导的时间建模,联合解决跨平台与跨模态问题。实验表明,相较于现有方法,本框架在多个评估协议下均取得显著性能提升。数据集与代码已开源。

原文摘要 · Abstract (English)

Person re-identification (Re-ID) across visible and infrared modalities is crucial for 24-hour surveillance systems, but existing datasets primarily focus on ground-level perspectives. While ground-based IR systems offer nighttime capabilities, they suffer from occlusions, limited coverage, and vulnerability to obstructions--problems that aerial perspectives uniquely solve. To address these limitations, we introduce AG-VPReID.VIR, the first aerial-ground cross-modality video-based person Re-ID dataset. This dataset captures 1,837 identities across 4,861 tracklets (124,855 frames) using both UAV-mounted and fixed CCTV cameras in RGB and infrared modalities. AG-VPReID.VIR presents unique challenges including cross-viewpoint variations, modality discrepancies, and temporal dynamics. Additionally, we propose TCC-VPReID, a novel three-stream architecture designed to address the joint challenges of cross-platform and cross-modality person Re-ID. Our approach bridges the domain gaps between aerial-ground perspectives and RGB-IR modalities, through style-robust feature learning, memory-based cross-view adaptation, and intermediary-guided temporal modeling. Experiments show that AG-VPReID.VIR presents distinctive challenges compared to existing datasets, with our TCC-VPReID framework achieving significant performance gains across multiple evaluation protocols. Dataset and code are available at https://github.com/agvpreid25/AG-VPReID.VIR.

行人重识别空地协同红外视觉视频分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。