arXiv:2501.07072cs.CV2025-01中稿 · IEEE/CVF Winter Co…被引 6

用不确定性建模提升无源域适应中伪标签质量

Label Calibration in Source Free Domain Adaptation

  • 引入证据深度学习捕捉预测不确定性,单次前向传播即可
  • 结合软最大值校准,有效降低噪声伪标签影响
  • 适用于有/无先验知识的域自适应场景,性能领先

无源域适应(SFDA)利用预训练源模型与无标签目标数据进行适配。自监督方法通过源模型生成伪标签,但因源-目标域差异导致伪标签含噪声。传统方法依赖确定性软最大值输出,难以应对不确定性。本文提出基于证据深度学习的伪标签优化方法:在目标网络输出上施加狄利克雷先验,通过一次前向传播捕获证据以表征不确定性;同时引入软最大值校准解决平移不变性问题,增强对噪声标签的学习能力。在有/无先验知识的两种设定下,融合证据学习损失与信息最大化损失,实现伪标签精炼。大量实验表明,该方法在基准数据集上优于现有最先进方法。

原文摘要 · Abstract (English)

Source-free domain adaptation (SFDA) utilizes a pre-trained source model with unlabeled target data. Self-supervised SFDA techniques generate pseudolabels from the pre-trained source model, but these pseudolabels often contain noise due to domain discrepancies between the source and target domains. Traditional self-supervised SFDA techniques rely on deterministic model predictions using the softmax function, leading to unreliable pseudolabels. In this work, we propose to introduce predictive uncertainty and softmax calibration for pseudolabel refinement using evidential deep learning. The Dirichlet prior is placed over the output of the target network to capture uncertainty using evidence with a single forward pass. Furthermore, softmax calibration solves the translation invariance problem to assist in learning with noisy labels. We incorporate a combination of evidential deep learning loss and information maximization loss with calibrated softmax in both prior and non-prior target knowledge SFDA settings. Extensive experimental analysis shows that our method outperforms other state-of-the-art methods on benchmark datasets.

域适应伪标签不确定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。