arXiv:2409.03509cs.CV2024-09中稿 · WACV25被引 7

通过领域自适应权重调制,提升小样本标注下的跨域泛化性能。

Domain-Guided Weight Modulation for Semi-Supervised Domain Generalization

  • 保留分类器对各源领域的专属性,动态生成领域感知掩码调权。
  • 在六个数据集上显著提升伪标签准确率,优于现有强基线方法。
  • 可无缝接入多种半监督学习框架,适合资源受限场景的领域泛化任务。

深度学习模型在仅使用少量标注数据的情况下实现对未见领域数据的泛化,具有重要的实际意义,开发成本低。为此,本文研究半监督领域泛化(SSDG)这一挑战性问题:在仅用少量标注数据和较多无标注数据的前提下,学习具备领域泛化能力的模型。现有领域泛化方法在SSDG设置下表现不佳,而半监督学习方法虽表现较好,但仍远逊于全监督领域泛化方法。为解决该问题,本文提出一种新方法,可在多种领域偏移下生成更准确的伪标签。其核心是训练过程中保留分类器对每个源领域的专属性,通过实时构建领域级信息向量,学习领域感知掩码以调制分类器权重。我们提供了该调制过程对伪标签生成与模型训练影响的数学解释。该方法即插即用,可应用于不同半监督学习基线。在两个不同设定下的六个挑战性数据集上的大量实验表明,该方法在多个强基线的SSDG方法上实现了显著提升。

原文摘要 · Abstract (English)

Unarguably, deep learning models capable of generalizing to unseen domain data while leveraging a few labels are of great practical significance due to low developmental costs. In search of this endeavor, we study the challenging problem of semi-supervised domain generalization (SSDG), where the goal is to learn a domain-generalizable model while using only a small fraction of labeled data and a relatively large fraction of unlabeled data. Domain generalization (DG) methods show subpar performance under the SSDG setting, whereas semi-supervised learning (SSL) methods demonstrate relatively better performance, however, they are considerably poor compared to the fully-supervised DG methods. Towards handling this new, but challenging problem of SSDG, we propose a novel method that can facilitate the generation of accurate pseudo-labels under various domain shifts. This is accomplished by retaining the domain-level specialism in the classifier during training corresponding to each source domain. Specifically, we first create domain-level information vectors on the fly which are then utilized to learn a domain-aware mask for modulating the classifier's weights. We provide a mathematical interpretation for the effect of this modulation procedure on both pseudo-labeling and model training. Our method is plug-and-play and can be readily applied to different SSL baselines for SSDG. Extensive experiments on six challenging datasets in two different SSDG settings show that our method provides visible gains over the various strong SSL-based SSDG baselines.

领域泛化半监督学习伪标签权重调制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。