arXiv:2511.16184cs.CV2025-11

解决可见光与红外行人重识别在真实场景中的域适应问题

Domain-Shared Learning and Gradual Alignment for Unsupervised Domain Adaptation Visible-Infrared Person Re-Identification

论文配图:Domain-Shared Learning and Gradual Alignment for Unsupervised Domain Adaptation Visible-Infrared Person Re-Identification
图 1 · 摘自论文原文
  • 分两阶段设计模型,先共享域间信息,再逐步对齐模态特征
  • 在多个真实数据集上超越现有无监督方法,接近有监督性能
  • 适合关注跨模态视觉识别与实际应用落地的研究者

近期,可见光-红外行人重识别(VI-ReID)在公开数据集上取得了显著进展。然而,由于公开数据集与真实场景数据存在差异,大多数现有方法在实际应用中表现不佳。为此,我们首次研究无监督域自适应可见光-红外行人重识别(UDA-VI-ReID),旨在将公共数据上学到的知识迁移至真实场景,无需新样本标注且不降低精度。具体地,我们分析了两大挑战:域间模态差异和域内模态差异。为此,提出两阶段新模型——域共享学习与渐进对齐(DSLGA)。第一阶段预训练中,采用域共享学习策略(DSLS),通过挖掘源域与目标域间的共享信息,缓解因域间模态差异导致的无效预训练。第二阶段微调中,设计渐进对齐策略(GAS),通过聚类到整体的对齐方式,解决可见光与红外数据间由大域内模态差异引发的跨模态对齐难题。最后,构建新的测试方法CMDA-XD,用于训练和评估不同UDA-VI-ReID模型。大量实验表明,本方法在多种设置下显著优于现有域适应方法,甚至超越部分有监督方法。

原文摘要 · Abstract (English)

Recently, Visible-Infrared person Re-Identification (VI-ReID) has achieved remarkable performance on public datasets. However, due to the discrepancies between public datasets and real-world data, most existing VI-ReID algorithms struggle in real-life applications. To address this, we take the initiative to investigate Unsupervised Domain Adaptation Visible-Infrared person Re-Identification (UDA-VI-ReID), aiming to transfer the knowledge learned from the public data to real-world data without compromising accuracy and requiring the annotation of new samples. Specifically, we first analyze two basic challenges in UDA-VI-ReID, i.e., inter-domain modality discrepancies and intra-domain modality discrepancies. Then, we design a novel two-stage model, i.e., Domain-Shared Learning and Gradual Alignment (DSLGA), to handle these discrepancies. In the first pre-training stage, DSLGA introduces a Domain-Shared Learning Strategy (DSLS) to mitigate ineffective pre-training caused by inter-domain modality discrepancies via exploiting shared information between the source and target domains. While, in the second fine-tuning stage, DSLGA designs a Gradual Alignment Strategy (GAS) to handle the cross-modality alignment challenges between visible and infrared data caused by the large intra-domain modality discrepancies through a cluster-to-holistic alignment way. Finally, a new UDA-VI-ReID testing method i.e., CMDA-XD, is constructed for training and testing different UDA-VI-ReID models. A large amount of experiments demonstrate that our method significantly outperforms existing domain adaptation methods for VI-ReID and even some supervised methods under various settings.

行人重识别域自适应跨模态无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。