arXiv:2412.04682cs.LGcs.AI2024-12

提出两阶段不变特征学习,解决图像识别中源域与目标域颜色差异大的问题。

Two stages domain invariant representation learners solve the large co-variate shift in unsupervised domain adaptation with two dimensional data domains

  • 分两阶段学习源-中间、中间-目标的不变特征,缓解颜色等协变量偏移。
  • 在38个任务上优于现有方法,显著提升目标域分类准确率。
  • 适合处理真实场景中数据分布差异大的无监督迁移任务。

近年来无监督域适应(UDA)技术使目标数据的无监督机器学习预测成为可能,从而加速自动驾驶中的图像识别等实际应用。然而当存在大规模协变量偏移时(如源域为单色手写数字,目标域为街景彩色数字),现有方法表现不佳。为此,本文提出两阶段域不变表示学习,通过语义中间数据(无标签)桥接源域与目标域。该方法可同时学习源-中间、中间-目标间的域不变特征,最终实现源-目标间良好的域不变表示与任务可区分性(得益于源标签)。这一机制显著改善梯度下降收敛性,提升目标域分类性能。我们还推导出一个定理,用于衡量训练模型与无监督目标标注规则之间的差距,支持自由参数优化。实验表明,该方法在4个代表性分类数据集上的38个典型任务中均优于先前方法,为应对大协变量偏移的挑战提供了坚实基础。

原文摘要 · Abstract (English)

Recent developments in the unsupervised domain adaptation (UDA) enable the unsupervised machine learning (ML) prediction for target data, thus this will accelerate real world applications with ML models such as image recognition tasks in self-driving. Researchers have reported the UDA techniques are not working well under large co-variate shift problems where e.g. supervised source data consists of handwritten digits data in monotone color and unsupervised target data colored digits data from the street view. Thus there is a need for a method to resolve co-variate shift and transfer source labelling rules under this dynamics. We perform two stages domain invariant representation learning to bridge the gap between source and target with semantic intermediate data (unsupervised). The proposed method can learn domain invariant features simultaneously between source and intermediate also intermediate and target. Finally this achieves good domain invariant representation between source and target plus task discriminability owing to source labels. This induction for the gradient descent search greatly eases learning convergence in terms of classification performance for target data even when large co-variate shift. We also derive a theorem for measuring the gap between trained models and unsupervised target labelling rules, which is necessary for the free parameters optimization. Finally we demonstrate that proposing method is superiority to previous UDA methods using 4 representative ML classification datasets including 38 UDA tasks. Our experiment will be a basis for challenging UDA problems with large co-variate shift.

域适应协变量偏移无监督学习图像识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。