用3D结构信息提升跨场景行人重识别,不依赖真实深度数据。
Reliability-Aware 3D Geometric Injection for Universal Person Re-identification

- 通过关节级3D表示分离几何提取与使用,避免噪声干扰。
- 引入自适应门控机制,仅在可靠时融合3D结构信息。
- 适合处理遮挡、换装等复杂场景,兼顾干净数据表现。
通用行人重识别(ReID)旨在统一模型中检索不同现实场景下的行人身份,包括严重遮挡、服装变化和跨模态迁移。现有2D表示因缺乏深度与拓扑感知,存在空间歧义;而盲目引入单目3D先验常因极端视觉退化下的几何估计噪声导致严重负向迁移。为安全利用3D几何的衣物不变性和标准结构特性,我们提出UniGeo:一种由一致性感知可靠性门控与双流残差融合驱动的通用单目3D增强ReID框架。具体而言,3D信息处理被策略性解耦为几何提取与动态利用。为提供纯粹结构补偿,我们将单目3D参数投影至运动学关节表示,显式捕捉实例级几何拓扑以解决基于外观的歧义。为鲁棒地融入这些线索而不扰动可靠的2D特征空间,我们将其作为晚期结构残差隔离;由一致性感知门控调节,该机制自适应过滤几何噪声,实现对纯2D基线的可控回退。大量实验表明,该方法在挑战性、结构敏感场景中显著提升性能,同时保持在干净域中的竞争力。代码已开源:https://github.com/BohanSu/UniGeo。
原文摘要 · Abstract (English)
Universal person re-identification (ReID) aims to retrieve pedestrian identities across diverse real-world scenarios, including severe occlusions, clothing changes, and cross-modality shifts, within a unified model. However, existing 2D representations fundamentally struggle with spatial ambiguities due to a lack of depth and topological awareness, while naively introducing monocular 3D priors often causes severe negative transfer due to geometric estimation noise under extreme visual degradation. To safely harness the clothing-invariant and canonical structural properties of 3D geometry, we propose UniGeo, a Universal Monocular 3D-Enhanced ReID framework driven by a Consistency-Aware Reliability Gate and Dual-Stream Residual Fusion. Specifically, the processing of 3D information is strategically decoupled into geometric extraction and dynamic utilization. To provide pure structural compensation, we project monocular 3D parameters into kinematic joint representations, explicitly capturing instance-level geometric topology to resolve appearance-based ambiguities. To robustly incorporate these cues without perturbing the reliable 2D feature space, we isolate the 3D prior as a late-stage structural residual; modulated by the consistency-aware gate, this mechanism adaptively filters geometric noise and enables controlled fallback to the pure 2D baseline. Extensive experiments show that our method improves challenging, structure-sensitive scenarios while preserving competitive performance on clean domains. Code is available at https://github.com/BohanSu/UniGeo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。