arXiv:2512.07760cs.CV2025-12AAAI被引 1

解决可见光与红外行人重识别中的模态偏差问题,提升无监督匹配准确率。

Modality-Aware Bias Mitigation and Invariance Learning for Unsupervised Visible-Infrared Person Re-Identification

  • 提出模态感知的雅可比距离,缓解跨模态距离偏差
  • 通过分拆对比策略学习模态不变特征,在多个数据集上达到领先性能
  • 适合关注跨模态学习与无监督行人重识别的研究者

无监督可见光-红外行人重识别(USVI-ReID)旨在不依赖任何标注的情况下,匹配跨可见光与红外摄像头的同一人。由于两模态间存在显著差异,可靠的跨模态关联估计成为主要挑战。现有方法通常采用最优传输来关联同模态聚类,易传播局部聚类误差,并忽略全局实例级关系。本文通过挖掘并关注可见光-红外模态偏差,从两个方面改进跨模态学习:偏差缓解的全局关联与模态不变表示学习。受单模态重识别中相机感知距离校正的启发,提出模态感知雅可比距离,以减轻由模态差异引起的距离偏差,从而通过全局聚类获得更可靠的跨模态关联。为进一步提升跨模态表示学习,设计了‘分拆-对比’策略,获取模态特定的全局原型。在全局关联引导下显式对齐这些原型,实现模态不变且身份区分性强的表示学习。尽管概念简单,该方法在基准VI-ReID数据集上取得当前最佳性能,显著优于已有方法,验证了其有效性。

原文摘要 · Abstract (English)

Unsupervised visible-infrared person re-identification (USVI-ReID) aims to match individuals across visible and infrared cameras without relying on any annotation. Given the significant gap across visible and infrared modality, estimating reliable cross-modality association becomes a major challenge in USVI-ReID. Existing methods usually adopt optimal transport to associate the intra-modality clusters, which is prone to propagating the local cluster errors, and also overlooks global instance-level relations. By mining and attending to the visible-infrared modality bias, this paper focuses on addressing cross-modality learning from two aspects: bias-mitigated global association and modality-invariant representation learning. Motivated by the camera-aware distance rectification in single-modality re-ID, we propose modality-aware Jaccard distance to mitigate the distance bias caused by modality discrepancy, so that more reliable cross-modality associations can be estimated through global clustering. To further improve cross-modality representation learning, a `split-and-contrast' strategy is designed to obtain modality-specific global prototypes. By explicitly aligning these prototypes under global association guidance, modality-invariant yet ID-discriminative representation learning can be achieved. While conceptually simple, our method obtains state-of-the-art performance on benchmark VI-ReID datasets and outperforms existing methods by a significant margin, validating its effectiveness.

行人重识别跨模态学习无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。