arXiv:2411.12558cs.CVcs.AI2024-11中稿 · TMLR 2025被引 10

提出新框架,让模型更好识别目标域中没见过的新类别。

Recall and Refine: A Simple but Effective Source-free Open-set Domain Adaptation Framework

  • 用合成数据增强目标域特征,显式学习未知类别的区分特征。
  • 在三个基准数据集上显著超越现有源无关开放集域适应方法。
  • 可无缝集成现有无源域适应方法,适合隐私敏感场景使用。

开放集域适应(OSDA)旨在将带标签源域的模型适配到无标签目标域,其中包含未见的新类别(即目标私有未知类)。源无关开放集域适应(SF-OSDA)方法在不访问源域标签数据的情况下解决此问题,适用于隐私受限场景。然而,由于分布偏移和新类别的引入,SF-OSDA面临巨大挑战。现有方法通常依赖预测熵阈值判断样本是否为已知或未知类别,但未能显式学习目标私有未知类的判别特征。本文提出召回与精炼(RRDA)框架,通过两阶段流程解决该问题:首先,利用目标域特征生成的合成样本训练一个带有额外决策边界的分类器,提升模型对未知类的识别能力;其次,将整个模型适配至目标域,同时缓解域偏移并增强对未知类的区分性。任何现成的无源域适应方法(如 SHOT、AaD)均可在此阶段无缝集成。大量实验证明,RRDA 在三个基准数据集上显著优于现有 SF-OSDA 与 OSDA 方法。

原文摘要 · Abstract (English)

Open-set Domain Adaptation (OSDA) aims to adapt a model from a labeled source domain to an unlabeled target domain, where novel classes - also referred to as target-private unknown classes - are present. Source-free Open-set Domain Adaptation (SF-OSDA) methods address OSDA without accessing labeled source data, making them particularly relevant under privacy constraints. However, SF-OSDA presents significant challenges due to distribution shifts and the introduction of novel classes. Existing SF-OSDA methods typically rely on thresholding the prediction entropy of a sample to identify it as either a known or unknown class, but fail to explicitly learn discriminative features for the target-private unknown classes. We propose Recall and Refine (RRDA), a novel SF-OSDA framework designed to address these limitations by explicitly learning features for target-private unknown classes. RRDA employs a two-stage process. First, we enhance the model's capacity to recognize unknown classes by training a target classifier with an additional decision boundary,guided by synthetic samples generated from target domain features. This enables the classifier to effectively separate known and unknown classes. Second, we adapt the entire model to the target domain, addressing both domain shifts and distinguishability to unknown classes. Any off-the-shelf source-free domain adaptation method (e.g. SHOT, AaD) can be seamlessly integrated into our framework at this stage. Extensive experiments on three benchmark datasets demonstrate that RRDA significantly outperforms existing SF-OSDA and OSDA methods.

域适应开放集无源未知类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。