通过3D空间统一视角,解决航拍与地面人物重识别中的视角偏差问题。
VR3D: View-Robust 3D Representation Learning for Aerial-Ground Person Re-Identification

- 将2D图像特征映射到统一3D空间,实现跨视角特征交互
- 在CARGO数据集上达到5.63%的Rank-1提升,优于现有方法
- 适用于航拍与地面交叉视角的行人重识别任务
由于跨平台视角差异导致严重遮挡和几何变形,航拍-地面人物重识别是一项极具挑战性的任务。现有方法仅在2D图像空间中学习视角不变表示,导致特征仍受视角偏见影响。为此,我们提出VR3D框架,将图像映射至统一的3D坐标空间,实现视角无关的特征交互。具体地,引入视图鲁棒3D表示交互(VR3I),利用单个2D观测提取的3D先验,将2D外观特征提升至规范3D空间。VR3I采用3D几何-语义注意力机制,基于3D空间位置建立2D块与对应身体部位3D体素间的交互,有效将2D语义锚定于3D框架。此外,由于表示可靠性随视角变化和3D重建误差而波动,我们设计了可靠性感知融合策略,估计样本级可靠性并自适应聚合多源表示。在三个基准数据集(CARGO、AG-ReID.v1、AG-ReID.v2)上的大量实验表明,VR3D显著优于近期方法,例如在CARGO上实现了5.63%的Rank-1提升。代码将公开发布。
原文摘要 · Abstract (English)
Aerial-ground person re-identification is a challenging task due to cross-platform viewpoint variations, which cause severe occlusion and geometric deformation. Existing methods attempt to learn view-invariant representations exclusively within the 2D image space, where drastic viewpoint variations cause the learned features to remain coupled with viewpoint bias. To address this, we propose VR3D, a View-Robust 3D Representation Learning framework that maps images into a unified 3D coordinate space to achieve view-independent feature interaction. Specifically, we introduce View-Robust 3D Representation Interaction, which leverages 3D priors extracted from single 2D observations to lift 2D appearance features into a canonical 3D space. VR3I employs 3D Geometry-Semantic Attention to establish interactions between 2D patches and 3D voxels from corresponding body parts based on their 3D spatial locations, effectively grounding 2D semantics within a 3D framework. In addition, as the reliability of these representations varies across samples due to viewpoint changes and 3D reconstruction errors, we introduce Reliability-Aware Fusion, which estimates sample-specific reliability and adaptively aggregates the multi-source representations. Extensive experiments on three benchmark datasets (CARGO, AG-ReID.v1, and AG-ReID.v2) demonstrate that VR3D outperforms recent methods. For example, it achieves a 5.63% improvement in Rank-1 on CARGO. Our code will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。