arXiv:2502.14214cs.LGcs.CV2025-02被引 1

用少量目标标签数据,实现更稳定的无源少样本域适应。

Asymmetric Co-Training for Source-Free Few-Shot Domain Adaptation

  • 设计不对称协同训练框架,利用弱强增强提升数据多样性。
  • 在四个基准上优于当前最优方法,小样本标签下性能显著提升。
  • 适合标签稀缺的真实场景,如医疗影像、工业检测等应用。

无源无监督域适应(SFUDA)因无需源端标签数据而受到关注,但其性能依赖于目标数据满足封闭集标签分布等假设,且常面临标注数据不足的困境。为此,本文提出针对源无少样本域适应(SFFSDA)的不对称协同训练(ACT)方法。该方法首先通过弱-强数据增强提升样本多样性,再采用两阶段优化:第一阶段联合优化标签平滑交叉熵损失、类条件分布熵与反熵损失,强化模型判别能力并抑制过拟合;第二阶段通过最小化分类器确定性差异来降低输出空间冗余。在四个基准上的大量实验表明,ACT显著优于现有SFUDA与迁移学习方法。结果表明,仅需少量目标标签即可有效适配预训练模型,是一种可行且可靠的实用方案。代码已开源。

原文摘要 · Abstract (English)

Source-free unsupervised domain adaptation (SFUDA) has gained significant attention as an alternative to traditional unsupervised domain adaptation (UDA), which relies on the constant availability of labeled source data. However, SFUDA approaches come with inherent limitations that are frequently overlooked. These challenges include performance degradation when the unlabeled target data fails to meet critical assumptions, such as having a closed-set label distribution identical to that of the source domain, or when sufficient unlabeled target data is unavailable-a common situation in real-world applications. To address these issues, we propose an asymmetric co-training (ACT) method specifically designed for the SFFSDA scenario. SFFSDA presents a more practical alternative to SFUDA, as gathering a few labeled target instances is more feasible than acquiring large volumes of unlabeled target data in many real-world contexts. Our ACT method begins by employing a weak-strong augmentation to enhance data diversity. Then we use a two-step optimization process to train the target model. In the first step, we optimize the label smoothing cross-entropy loss, the entropy of the class-conditional distribution, and the reverse-entropy loss to bolster the model's discriminative ability while mitigating overfitting. The second step focuses on reducing redundancy in the output space by minimizing classifier determinacy disparity. Extensive experiments across four benchmarks demonstrate the superiority of our ACT approach, which outperforms state-of-the-art SFUDA methods and transfer learning techniques. Our findings suggest that adapting a source pre-trained model using only a small amount of labeled target data offers a practical and dependable solution. The code is available at https://github.com/gengxuli/ACT.

域适应少样本学习无源学习协同训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。