arXiv:2412.20670cs.LGcs.CV2024-12

提出新方法在不暴露数据情况下,提升无监督域适应性能。

Prototypical Distillation and Debiased Tuning for Black-box Unsupervised Domain Adaptation

  • 用源模型预测和目标域原型作为教师,蒸馏定制化目标模型。
  • 通过惩罚类别偏倚的输出,进一步优化模型,在多个基准上领先。
  • 适合关注隐私保护的黑盒场景,尤其适用于仅提供标签的限制环境。

无监督域适应旨在将标注丰富的源域知识迁移到无标注的目标域,降低人工标注成本。近年来,源自由域适应受到关注,即仅提供预训练模型而非源数据。由于模型反演攻击可能导致源数据泄露,本文提出一种新设置:黑盒域适应,其中源模型仅可通过接口访问,每次查询返回预测标签及置信度。为此,我们设计两阶段框架ProDDing:第一阶段利用源模型原始预测与目标域原型作为教师,蒸馏出定制化目标模型;第二阶段通过惩罚偏向特定类别的输出,继续微调蒸馏模型。多基准实验证明,ProDDing优于现有黑盒域适应方法;在仅提供硬标签的场景下亦显著提升。代码将在https://github.com/tim-learn/ProDDing/发布。

原文摘要 · Abstract (English)

Unsupervised domain adaptation aims to transfer knowledge from a related, label-rich source domain to an unlabeled target domain, thereby circumventing the high costs associated with manual annotation. Recently, there has been growing interest in source-free domain adaptation, a paradigm in which only a pre-trained model, rather than the labeled source data, is provided to the target domain. Given the potential risk of source data leakage via model inversion attacks, this paper introduces a novel setting called black-box domain adaptation, where the source model is accessible only through an API that provides the predicted label along with the corresponding confidence value for each query. We develop a two-step framework named $\textbf{Pro}$totypical $\textbf{D}$istillation and $\textbf{D}$ebiased tun$\textbf{ing}$ ($\textbf{ProDDing}$). In the first step, ProDDing leverages both the raw predictions from the source model and prototypes derived from the target domain as teachers to distill a customized target model. In the second step, ProDDing keeps fine-tuning the distilled model by penalizing logits that are biased toward certain classes. Empirical results across multiple benchmarks demonstrate that ProDDing outperforms existing black-box domain adaptation methods. Moreover, in the case of hard-label black-box domain adaptation, where only predicted labels are available, ProDDing achieves significant improvements over these methods. Code will be available at \url{https://github.com/tim-learn/ProDDing/}.

域适应蒸馏黑盒

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。