通过协同与对抗学习,提升无监督域适应的特征判别性与域不变性。
Self-Paced Collaborative and Adversarial Network for Unsupervised Domain Adaptation
- 利用协同与对抗学习统一建模特征表示,分层提取域特定与域不变特征。
- 在Office-31等数据集上实现最新性能,目标域准确率最高达95.6%。
- 适合需要跨域迁移且无标签数据的视觉识别任务研究者使用。
本文提出一种新的无监督域适应方法——协同与对抗网络(CAN),采用域协同与域对抗学习策略训练神经网络。域协同学习旨在保留目标域的判别性,学习域特定特征表示;域对抗学习则旨在减少源域与目标域之间的分布差异,学习域不变特征表示。我们证明这两种学习策略可统一表述为带正负权重的域分类器学习。进而设计了协同与对抗联合训练机制:通过协同学习从CNN低层自动提取域特定表示,通过对抗学习从高层提取域不变表示。为进一步增强目标域判别性,提出自适应步进式CAN(SPCAN),以由易到难的方式逐步选择伪标签样本进行分类器重训练。在对象识别任务的Office-31、ImageCLEF-DA、VISDA-2017,以及视频动作识别任务的UCF101-10和HMDB51-10多个基准数据集上的大量实验表明,所提方法达到当前最优性能,充分验证了其有效性。
原文摘要 · Abstract (English)
This paper proposes a new unsupervised domain adaptation approach called Collaborative and Adversarial Network (CAN), which uses the domain-collaborative and domain-adversarial learning strategy for training the neural network. The domain-collaborative learning aims to learn domain-specific feature representation to preserve the discriminability for the target domain, while the domain adversarial learning aims to learn domain-invariant feature representation to reduce the domain distribution mismatch between the source and target domains. We show that these two learning strategies can be uniformly formulated as domain classifier learning with positive or negative weights on the losses. We then design a collaborative and adversarial training scheme, which automatically learns domain-specific representations from lower blocks in CNNs through collaborative learning and domain-invariant representations from higher blocks through adversarial learning. Moreover, to further enhance the discriminability in the target domain, we propose Self-Paced CAN (SPCAN), which progressively selects pseudo-labeled target samples for re-training the classifiers. We employ a self-paced learning strategy to select pseudo-labeled target samples in an easy-to-hard fashion. Comprehensive experiments on different benchmark datasets, Office-31, ImageCLEF-DA, and VISDA-2017 for the object recognition task, and UCF101-10 and HMDB51-10 for the video action recognition task, show our newly proposed approaches achieve the state-of-the-art performance, which clearly demonstrates the effectiveness of our proposed approaches for unsupervised domain adaptation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。