arXiv:2411.06665cs.CV2024-11被引 2

针对不同目标样本设计差异化学习策略,提升无源半监督域适应性能。

Learning from Different Samples: A Source-free Framework for Semi-supervised Domain Adaptation

  • 按样本类型分治:对未标注、可靠标注、噪声伪标签分别设计学习策略。
  • 在ImageNet-C和Office-Home上达到新最优,准确率提升1.5%~3.2%。
  • 适合处理复杂分布的目标域,尤其对噪声标签鲁棒性强。

半监督域适应(SSDA)因能利用少量目标域标签数据提升模型泛化能力而受到广泛关注。然而,现有方法仅关注对目标样本的统一适应策略,忽略了针对不同类型目标样本的定制化学习。当目标分布复杂时,模型难以全面学习多类样本知识,导致性能受限。为此,本文提出一种新型无源框架SOUF,实现对源预训练模型在目标域上的半监督微调。SOUF从不同目标样本视角解耦SSDA:针对未标注样本,采用基于概率的加权对比学习(PWC),增强特征判别性;为挖掘标注样本的潜在知识,引入基于可靠性的Mixup对比学习(RMC),从构建的可靠样本集中学习复杂模式;最后通过预测正则化学习(PR)缓解噪声伪标签对模型的误导。在多个基准数据集上的实验表明,该框架显著优于当前最优方法。

原文摘要 · Abstract (English)

Semi-supervised domain adaptation (SSDA) has been widely studied due to its ability to utilize a few labeled target data to improve the generalization ability of the model. However, existing methods only consider designing certain strategies for target samples to adapt, ignoring the exploration of customized learning for different target samples. When the model encounters complex target distribution, existing methods will perform limited due to the inability to clearly and comprehensively learn the knowledge of multiple types of target samples. To fill this gap, this paper focuses on designing a framework to use different strategies for comprehensively mining different target samples. We propose a novel source-free framework (SOUF) to achieve semi-supervised fine-tuning of the source pre-trained model on the target domain. Different from existing SSDA methods, SOUF decouples SSDA from the perspectives of different target samples, specifically designing robust learning techniques for unlabeled, reliably labeled, and noisy pseudo-labeled target samples. For unlabeled target samples, probability-based weighted contrastive learning (PWC) helps the model learn more discriminative feature representations. To mine the latent knowledge of labeled target samples, reliability-based mixup contrastive learning (RMC) learns complex knowledge from the constructed reliable sample set. Finally, predictive regularization learning (PR) further mitigates the misleading effect of noisy pseudo-labeled samples on the model. Extensive experiments on benchmark datasets demonstrate the superiority of our framework over state-of-the-art methods.

域适应半监督无源学习对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。