arXiv:2506.20841cs.CVcs.AI2025-06

通过伪标签增强对比学习,提升少样本下的跨域泛化能力

FixCLR: Negative-Class Contrastive Learning for Semi-Supervised Domain Generalization

  • 利用伪标签构建类别对比,显式约束跨域不变特征
  • 仅保留排斥项,避免冗余正则化干扰模型学习
  • 可无缝集成现有方法,尤其适合小标签数据场景

半监督域泛化(SSDG)旨在仅有少量标注数据时实现对分布外数据的泛化。由于标签稀缺,传统域泛化方法性能下降。现有方法虽结合半监督学习与多种正则项,但未显式约束跨域不变表示,而这正是域泛化的核心目标。为此,本文提出FixCLR。受自监督学习成功启发,我们调整两个关键组件:利用伪标签中的类别信息,并仅采用排斥项。该方法可附加于多数现有SSDG与半监督方法之上,实现互补性性能提升。研究包含多项未在先前SSDG中探索的实验,涵盖不同半监督改进策略的基准测试、预训练与非预训练模型的对比,以及多域数据集上的验证。结果表明,FixCLR是一种有效的SSDG方法,尤其在与其他半监督方法结合时表现突出。

原文摘要 · Abstract (English)

Semi-supervised domain generalization (SSDG) aims to solve the problem of generalizing to out-of-distribution data when only a few labels are available. Due to label scarcity, applying domain generalization methods often underperform. Consequently, existing SSDG methods combine semi-supervised learning methods with various regularization terms. However, these methods do not explicitly regularize to learn domains invariant representations across all domains, which is a key goal for domain generalization. To address this, we introduce FixCLR. Inspired by success in self-supervised learning, we change two crucial components to adapt contrastive learning for explicit domain invariance regularization: utilization of class information from pseudo-labels and using only a repelling term. FixCLR can also be added on top of most existing SSDG and semi-supervised methods for complementary performance improvements. Our research includes extensive experiments that have not been previously explored in SSDG studies. These experiments include benchmarking different improvements to semi-supervised methods, evaluating the performance of pretrained versus non-pretrained models, and testing on datasets with many domains. Overall, FixCLR proves to be an effective SSDG method, especially when combined with other semi-supervised methods.

半监督域泛化对比学习伪标签

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。