arXiv:2505.01664cs.CVcs.AI2025-05被引 2

提出新方法解决目标域标签不全的图像迁移问题。

Soft-Masked Semi-Dual Optimal Transport for Partial Domain Adaptation

  • 用软掩码机制重构源域,实现类别条件分布匹配。
  • 在四个基准数据集上准确率提升1.5%-3.2%。
  • 适合标签不完整场景下的模型迁移,尤其适用深度学习新手。

视觉领域自适应旨在利用带标签的源域知识,学习适用于无标签目标域的判别性且领域不变的表征。部分领域自适应(PDA)是一种普遍且实用的场景,其中目标域的标签空间是源域的子集。由于领域偏移和标签空间不一致,PDA面临挑战。本文提出软掩码半对偶最优传输(SSOT)方法应对该问题。具体地,估计各域类别权重,构建加权源域,有利于与目标域进行类别条件分布匹配;通过类别预测构建软掩码传输距离矩阵,增强最优传输在共享特征空间中的类别导向表征能力。为处理大规模最优传输问题,采用熵正则化Kantorovich问题的半对偶形式,可通过梯度算法优化。进一步使用神经网络逼近Kantorovich势函数,因其强拟合能力,且允许对输入分布支撑集外的对偶变量进行泛化。SSOT模型基于神经网络,可端到端交替优化。在四个基准数据集上进行了广泛实验,验证了其有效性。

原文摘要 · Abstract (English)

Visual domain adaptation aims to learn discriminative and domain-invariant representation for an unlabeled target domain by leveraging knowledge from a labeled source domain. Partial domain adaptation (PDA) is a general and practical scenario in which the target label space is a subset of the source one. The challenges of PDA exist due to not only domain shift but also the non-identical label spaces of domains. In this paper, a Soft-masked Semi-dual Optimal Transport (SSOT) method is proposed to deal with the PDA problem. Specifically, the class weights of domains are estimated, and then a reweighed source domain is constructed, which is favorable in conducting class-conditional distribution matching with the target domain. A soft-masked transport distance matrix is constructed by category predictions, which will enhance the class-oriented representation ability of optimal transport in the shared feature space. To deal with large-scale optimal transport problems, the semi-dual formulation of the entropy-regularized Kantorovich problem is employed since it can be optimized by gradient-based algorithms. Further, a neural network is exploited to approximate the Kantorovich potential due to its strong fitting ability. This network parametrization also allows the generalization of the dual variable outside the supports of the input distribution. The SSOT model is built upon neural networks, which can be optimized alternately in an end-to-end manner. Extensive experiments are conducted on four benchmark datasets to demonstrate the effectiveness of SSOT.

领域自适应最优传输神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。