提出新方法提升无监督域泛化能力,让模型更适应未见领域数据。
DomCLP: Domain-wise Contrastive Learning with Prototype Mixup for Unsupervised Domain Generalization
- 按领域分组对比学习,强化跨域共性特征
- 引入原型混合机制,不依赖强假设实现泛化
- 在PACS和DomainNet上优于现有方法,适配少样本场景
基于实例判别任务的自监督学习(SSL)在InfoNCE框架下取得显著进展,但其生成的表征对未见领域数据表现不佳。为此,研究无监督域泛化(UDG)旨在构建能提取域无关特征的SSL模型。现有方法多采用InfoNCE对比学习并基于强假设进行特征对齐,以从多源域中学习通用特征,但此类方法在实例判别任务下易抑制域无关共性特征、放大域相关特征,阻碍域泛化。此外,强假设可能导致特征学习偏差,降低共性特征多样性。本文提出新方法DomCLP:域级对比学习(DCon)增强域无关共性特征,原型混合学习(PMix)在无需强假设前提下实现跨域共性特征泛化。该方法在PACS与DomainNet数据集上,于多种标签比例下均持续超越当前最优方法,显著提升性能。代码将开源。
原文摘要 · Abstract (English)
Self-supervised learning (SSL) methods based on the instance discrimination tasks with InfoNCE have achieved remarkable success. Despite their success, SSL models often struggle to generate effective representations for unseen-domain data. To address this issue, research on unsupervised domain generalization (UDG), which aims to develop SSL models that can generate domain-irrelevant features, has been conducted. Most UDG approaches utilize contrastive learning with InfoNCE to generate representations, and perform feature alignment based on strong assumptions to generalize domain-irrelevant common features from multi-source domains. However, existing methods that rely on instance discrimination tasks are not effective at extracting domain-irrelevant common features. This leads to the suppression of domain-irrelevant common features and the amplification of domain-relevant features, thereby hindering domain generalization. Furthermore, strong assumptions underlying feature alignment can lead to biased feature learning, reducing the diversity of common features. In this paper, we propose a novel approach, DomCLP, Domain-wise Contrastive Learning with Prototype Mixup. We explore how InfoNCE suppresses domain-irrelevant common features and amplifies domain-relevant features. Based on this analysis, we propose Domain-wise Contrastive Learning (DCon) to enhance domain-irrelevant common features. We also propose Prototype Mixup Learning (PMix) to generalize domain-irrelevant common features across multiple domains without relying on strong assumptions. The proposed method consistently outperforms state-of-the-art methods on the PACS and DomainNet datasets across various label fractions, showing significant improvements. Our code will be released. Our project page is available at https://github.com/jinsuby/DomCLP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。