arXiv:2504.11992cs.LGcs.CV2025-04中稿 · the 33rd European …被引 1

研究在线无源通用域适应中伪标签的作用,发现准确率比数量更重要。

Analysis of Pseudo-Labeling for Online Source-Free Universal Domain Adaptation

  • 通过模拟实验分析伪标签对模型性能的影响机制。
  • 发现当前最佳方法与理想伪标签下的上限仍有显著差距。
  • 建议优先使用少量高置信度伪标签,提升适应效果。

训练与测试数据间的分布差异常导致深度神经网络在真实场景中表现不佳,需通过无监督域适应(UDA)来缓解。在线无源通用域适应(SF-UniDA)应对实际中无法获取源数据且目标数据持续流入的场景,但现实应用还存在类别漂移问题,即源与目标标签空间可能不同。现有方法主要依赖伪标签自训练,但其与适应效果的关系尚未深入研究。本文通过受控实验系统分析伪标签的作用,揭示当前最优方法与理想伪标签上限之间存在显著差距。结果表明,对比损失即使在伪标签准确率中等时仍能有效适应;而交叉熵损失虽对错误伪标签敏感,但在伪标签接近完美时表现更优。此外,伪标签准确率的重要性高于数量,提示应优先选择少数高置信度伪标签。研究强调了伪标签在(在线)无源通用域适应中的核心作用,并为未来工作提供实用指导。代码已公开于 https://github.com/pascalschlachter/PLAnalysis。

原文摘要 · Abstract (English)

A domain (distribution) shift between training and test data often hinders the real-world performance of deep neural networks, necessitating unsupervised domain adaptation (UDA) to bridge this gap. Online source-free UDA has emerged as a solution for practical scenarios where access to source data is restricted and target data is received as a continuous stream. However, the open-world nature of many real-world applications additionally introduces category shifts meaning that the source and target label spaces may differ. Online source-free universal domain adaptation (SF-UniDA) addresses this challenge. Existing methods mainly rely on self-training with pseudo-labels, yet the relationship between pseudo-labeling and adaptation outcomes has not been studied yet. To bridge this gap, we conduct a systematic analysis through controlled experiments with simulated pseudo-labeling, offering valuable insights into pseudo-labeling for online SF-UniDA. Our findings reveal a substantial gap between the current state-of-the-art and the upper bound of adaptation achieved with perfect pseudo-labeling. Moreover, we show that a contrastive loss enables effective adaptation even with moderate pseudo-label accuracy, while a cross-entropy (CE) loss, though less robust to pseudo-label errors, achieves superior results when pseudo-labeling approaches perfection. Lastly, our findings indicate that pseudo-label accuracy is in general more crucial than quantity, suggesting that prioritizing fewer but high-confidence pseudo-labels is beneficial. Overall, our study highlights the critical role of pseudo-labeling in (online) SF-UniDA and provides actionable insights to drive future advancements in the field. Our code is available at https://github.com/pascalschlachter/PLAnalysis.

域适应伪标签无源学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。