arXiv:2505.02549cs.CVcs.MM2025-05被引 26

解决红外可见光行人重识别中伪标签噪声问题

Robust Duality Learning for Unsupervised Visible-Infrared Person Re-Identification

  • 提出鲁棒双模学习框架,动态区分干净样本与噪声数据
  • 在三个基准上实现新纪录,准确率提升显著
  • 适合无监督跨模态行人识别研究者参考

无监督可见光-红外行人重识别(UVI-ReID)旨在无需昂贵标注的情况下跨模态检索行人图像,但面临模态差异大和缺乏监督的挑战。现有方法通常采用聚类生成伪标签进行自训练,隐含假设伪标签始终正确,但实际中伪标签存在噪声,导致模型学习受阻。为此,本文提出新的鲁棒对偶学习范式,明确考虑伪标签噪声,针对噪声过拟合、错误累积和噪声聚类对应三大难题。提出鲁棒自适应学习机制(RAL),动态加权样本以抑制噪声;采用双模型交替训练策略,通过互伪标签增强多样性,防止模型坍塌;引入聚类一致性匹配(CCM),通过跨聚类相似性度量对齐不同模型与模态间的聚类结构。在三个基准数据集上的大量实验表明,所提方法显著优于现有方法。

原文摘要 · Abstract (English)

Unsupervised visible-infrared person re-identification (UVI-ReID) aims to retrieve pedestrian images across different modalities without costly annotations, but faces challenges due to the modality gap and lack of supervision. Existing methods often adopt self-training with clustering-generated pseudo-labels but implicitly assume these labels are always correct. In practice, however, this assumption fails due to inevitable pseudo-label noise, which hinders model learning. To address this, we introduce a new learning paradigm that explicitly considers Pseudo-Label Noise (PLN), characterized by three key challenges: noise overfitting, error accumulation, and noisy cluster correspondence. To this end, we propose a novel Robust Duality Learning framework (RoDE) for UVI-ReID to mitigate the effects of noisy pseudo-labels. First, to combat noise overfitting, a Robust Adaptive Learning mechanism (RAL) is proposed to dynamically emphasize clean samples while down-weighting noisy ones. Second, to alleviate error accumulation-where the model reinforces its own mistakes-RoDE employs dual distinct models that are alternately trained using pseudo-labels from each other, encouraging diversity and preventing collapse. However, this dual-model strategy introduces misalignment between clusters across models and modalities, creating noisy cluster correspondence. To resolve this, we introduce Cluster Consistency Matching (CCM), which aligns clusters across models and modalities by measuring cross-cluster similarity. Extensive experiments on three benchmarks demonstrate the effectiveness of RoDE.

行人重识别无监督学习跨模态伪标签

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。