无需判别器的多标签图像分类域适应方法,提升精度且参数更少。
Domain Adaptation for Multi-label Image Classification: a Discriminator-free Approach
- 用任务特定分类器直接构造对抗性评估器,避免传统判别器干扰
- 在三种域偏移数据集上精度优于现有方法,参数量更低
- 基于高斯混合模型与弗雷歇距离,可微且计算高效,适合实际部署
本文提出一种无判别器的对抗式无监督域适应方法DDA-MLIC,用于多标签图像分类。现有方法通常引入额外判别子网,但可能削弱分类任务的判别能力。为此,本文提出从任务特定分类器直接构建对抗性评估器:利用两分量高斯混合模型(GMM)建模源域与目标域预测分布,区分两类簇;不采用传统期望最大化(EM)算法,而是通过深度神经网络(DNN)估计每个GMM成分参数;进而使用弗雷歇距离构建对抗损失。该框架完全可微,且避免了标准EM带来的昂贵迭代过程,计算更高效。在涵盖三种不同域偏移的多个多标签图像数据集上测试表明,DDA-MLIC在精度上优于现有最优方法,同时所需参数更少。代码已公开于github.com/cvi2snt/DDA-MLIC。
原文摘要 · Abstract (English)
This paper introduces a discriminator-free adversarial-based approach termed DDA-MLIC for Unsupervised Domain Adaptation (UDA) in the context of Multi-Label Image Classification (MLIC). While recent efforts have explored adversarial-based UDA methods for MLIC, they typically include an additional discriminator subnet. Nevertheless, decoupling the classification and the discrimination tasks may harm their task-specific discriminative power. Herein, we address this challenge by presenting a novel adversarial critic directly derived from the task-specific classifier. Specifically, we employ a two-component Gaussian Mixture Model (GMM) to model both source and target predictions, distinguishing between two distinct clusters. Instead of using the traditional Expectation Maximization (EM) algorithm, our approach utilizes a Deep Neural Network (DNN) to estimate the parameters of each GMM component. Subsequently, the source and target GMM parameters are leveraged to formulate an adversarial loss using the Fréchet distance. The proposed framework is therefore not only fully differentiable but is also cost-effective as it avoids the expensive iterative process usually induced by the standard EM method. The proposed method is evaluated on several multi-label image datasets covering three different types of domain shift. The obtained results demonstrate that DDA-MLIC outperforms existing state-of-the-art methods in terms of precision while requiring a lower number of parameters. The code is made publicly available at github.com/cvi2snt/DDA-MLIC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。