arXiv:2412.14301cs.CVcs.LG2024-12被引 8

通过利用源模型指导的隐空间增强,提升无源域适应中对比学习性能。

What Has Been Overlooked in Contrastive Source-Free Domain Adaptation: Leveraging Source-Informed Latent Augmentation within Neighborhood Context

  • 基于源模型引导的邻域隐空间扰动,增强正样本信息量。
  • 在多个标准数据集上超越现有最先进方法,最高提升3.2%准确率。
  • 适合关注隐私保护下模型迁移的开发者与研究人员。

无源域适应(SFDA)旨在不访问源域数据的情况下,将源域预训练模型适配至目标域。由于缺乏源数据,难以量化域间差异。本文针对对比学习范式进行理论分析,发现邻域内隐特征分布可作为关键信息源。据此提出一种简单有效的隐空间增强方法:利用源模型对查询样本邻域特征的分散性进行引导,提升正样本键的语义丰富度。该方法仅依赖单一InfoNCE损失,在广泛使用的基准数据集上表现优异,显著优于当前最优方法,最大提升达3.2%。

原文摘要 · Abstract (English)

Source-free domain adaptation (SFDA) involves adapting a model originally trained using a labeled dataset ({\em source domain}) to perform effectively on an unlabeled dataset ({\em target domain}) without relying on any source data during adaptation. This adaptation is especially crucial when significant disparities in data distributions exist between the two domains and when there are privacy concerns regarding the source model's training data. The absence of access to source data during adaptation makes it challenging to analytically estimate the domain gap. To tackle this issue, various techniques have been proposed, such as unsupervised clustering, contrastive learning, and continual learning. In this paper, we first conduct an extensive theoretical analysis of SFDA based on contrastive learning, primarily because it has demonstrated superior performance compared to other techniques. Motivated by the obtained insights, we then introduce a straightforward yet highly effective latent augmentation method tailored for contrastive SFDA. This augmentation method leverages the dispersion of latent features within the neighborhood of the query sample, guided by the source pre-trained model, to enhance the informativeness of positive keys. Our approach, based on a single InfoNCE-based contrastive loss, outperforms state-of-the-art SFDA methods on widely recognized benchmark datasets.

无源域适应对比学习隐空间增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。