arXiv:2509.17452cs.CVcs.AI2025-09被引 1

不训练直接对齐标签空间,让模型更好适应未知类别分布的域迁移。

Training-Free Label Space Alignment for Universal Domain Adaptation

  • 利用CLIP等视觉语言模型识别目标域未知类别,通过过滤噪声标签实现标签空间对齐。
  • 在DomainBed上平均提升7.9% H-score和6.1% H³-score,显著优于现有方法。
  • 无需微调,适合部署在标签空间不完全已知的现实场景中。

通用域适应(UniDA)将标注源域的知识迁移到无标注目标域,但目标域可能包含源域没有的私有类别,且标签空间可能不同。以往方法主要关注视觉空间对齐,但受内容差异影响易产生视觉模糊,限制了鲁棒性与泛化能力。本文提出一种无需训练的标签空间对齐方法,利用视觉语言基础模型(如CLIP)的零样本能力,聚焦于标签空间而非视觉空间的对齐。首先使用生成式视觉语言模型探测目标域中的未知类别;针对发现标签中存在的噪声和语义歧义(如同义词、上下位词),提出训练免费的标签空间对齐策略,通过清洗与精炼跨域标签。随后构建融合共享知识与目标私有类信息的通用分类器,提升域偏移下的泛化性能。实验表明,在关键DomainBed基准上,该方法平均提升7.9% H-score与6.1% H³-score;引入自训练后,进一步获得1.6%的增益。

原文摘要 · Abstract (English)

Universal domain adaptation (UniDA) transfers knowledge from a labeled source domain to an unlabeled target domain, where label spaces may differ and the target domain may contain private classes. Previous UniDA methods primarily focused on visual space alignment but often struggled with visual ambiguities due to content differences, which limited their robustness and generalizability. To overcome this, we introduce a novel approach that leverages the strong \textit{zero-shot capabilities} of recent vision-language foundation models (VLMs) like CLIP, concentrating solely on label space alignment to enhance adaptation stability. CLIP can generate task-specific classifiers based only on label names. However, adapting CLIP to UniDA is challenging because the label space is not fully known in advance. In this study, we first utilize generative vision-language models to identify unknown categories in the target domain. Noise and semantic ambiguities in the discovered labels -- such as those similar to source labels (e.g., synonyms, hypernyms, hyponyms) -- complicate label alignment. To address this, we propose a training-free label-space alignment method for UniDA (\ours). Our method aligns label spaces instead of visual spaces by filtering and refining noisy labels between the domains. We then construct a \textit{universal classifier} that integrates both shared knowledge and target-private class information, thereby improving generalizability under domain shifts. The results reveal that the proposed method considerably outperforms existing UniDA techniques across key DomainBed benchmarks, delivering an average improvement of \textcolor{blue}{+7.9\%}in H-score and \textcolor{blue}{+6.1\%} in H$^3$-score. Furthermore, incorporating self-training further enhances performance and achieves an additional (\textcolor{blue}{+1.6\%}) increment in both H- and H$^3$-scores.

域适应标签对齐零样本CLIP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。