arXiv:2410.15811cs.CV2024-10被引 2

用少量源数据实现跨域迁移,保护隐私还更高效。

Data-Efficient CLIP-Powered Dual-Branch Networks for Source-Free Unsupervised Domain Adaptation

  • 双分支结构:一个传语义,一个学目标特征
  • 仅需少量源样本,在7个数据集上表现接近顶尖水平
  • 适合数据少且注重隐私的现实场景

源域无监督域自适应(SF-UDA)旨在不访问源域样本的情况下,将模型性能从有标签的源域迁移到无标签的目标域,解决关键的数据隐私问题。然而,现有方法大多假设源域样本充足,这在实际中因标注成本高而难以实现。为此,我们提出一种数据高效的CLIP驱动双分支网络(CDBN)。该架构包含跨域特征迁移分支和目标特定特征学习分支,利用高置信度的目标域样本传递源域类别的文本特征,同时学习目标特定的软提示。通过融合两个分支输出,该方法不仅有效将源域类别语义信息迁移到目标域,还降低了噪声和域差异对目标训练的负面影响。此外,我们设计了一种由准确分类和多样性驱动的无监督优化策略,在保留源域分类能力的同时,提升目标域预测的置信度与多样性。CDBN在7个数据集上的31项迁移任务中,使用远少于现有方法的源域样本,达到接近最先进的性能。

原文摘要 · Abstract (English)

Source-free Unsupervised Domain Adaptation (SF-UDA) aims to transfer a model's performance from a labeled source domain to an unlabeled target domain without direct access to source samples, addressing critical data privacy concerns. However, most existing SF-UDA approaches assume the availability of abundant source domain samples, which is often impractical due to the high cost of data annotation. To address the dual challenges of limited source data and privacy concerns, we introduce a data-efficient, CLIP-powered dual-branch network (CDBN). This architecture consists of a cross-domain feature transfer branch and a target-specific feature learning branch, leveraging high-confidence target domain samples to transfer text features of source domain categories while learning target-specific soft prompts. By fusing the outputs of both branches, our approach not only effectively transfers source domain category semantic information to the target domain but also reduces the negative impacts of noise and domain gaps during target training. Furthermore, we propose an unsupervised optimization strategy driven by accurate classification and diversity, preserving the classification capability learned from the source domain while generating more confident and diverse predictions in the target domain. CDBN achieves near state-of-the-art performance with far fewer source domain samples than existing methods across 31 transfer tasks on seven datasets.

域自适应CLIP数据效率隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。