提出兼顾迁移性与判别性的无监督域适应新方法
On the Transferability and Discriminability of Repersentation Learning in Unsupervised Domain Adaptation
- 从信息论出发,指出传统方法忽略目标域特征判别性
- 引入判别性增强损失,在多个数据集上超越现有方法
- 适合关注域适应理论与性能提升的研究者
本文针对无监督域适应(UDA)中仅依赖分布对齐和源域经验风险最小化的局限性,通过信息论分析发现,标准对抗框架忽略了目标域特征的判别性,导致性能不佳。为此,我们定义‘良好表征学习’需同时保证迁移性和判别性,并证明需额外引入针对目标域判别性的损失项。基于此,提出新型对抗式UDA框架——全局与局部一致性表征学习(RLGLC),利用非对称松弛的Wasserstein距离(AR-WWD)缓解类别不平衡与语义维度权重问题,并引入局部一致性机制保留细粒度判别信息。在多个基准数据集上的实验表明,RLGLC持续优于当前最优方法,验证了理论视角的有效性,强调了在对抗式UDA中同时约束迁移性与判别性的必要性。
原文摘要 · Abstract (English)
In this paper, we addressed the limitation of relying solely on distribution alignment and source-domain empirical risk minimization in Unsupervised Domain Adaptation (UDA). Our information-theoretic analysis showed that this standard adversarial-based framework neglects the discriminability of target-domain features, leading to suboptimal performance. To bridge this theoretical-practical gap, we defined "good representation learning" as guaranteeing both transferability and discriminability, and proved that an additional loss term targeting target-domain discriminability is necessary. Building on these insights, we proposed a novel adversarial-based UDA framework that explicitly integrates a domain alignment objective with a discriminability-enhancing constraint. Instantiated as Domain-Invariant Representation Learning with Global and Local Consistency (RLGLC), our method leverages Asymmetrically-Relaxed Wasserstein of Wasserstein Distance (AR-WWD) to address class imbalance and semantic dimension weighting, and employs a local consistency mechanism to preserve fine-grained target-domain discriminative information. Extensive experiments across multiple benchmark datasets demonstrate that RLGLC consistently surpasses state-of-the-art methods, confirming the value of our theoretical perspective and underscoring the necessity of enforcing both transferability and discriminability in adversarial-based UDA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。