自动筛选多源知识,提升无监督跨域迁移效果
Autonomous Source Knowledge Selection in Multi-Domain Adaptation
- 基于密度驱动策略自动选源样本和模型
- 在真实数据集上显著优于现有方法
- 适合大规模多源域适应场景
无监督多域自适应通过利用多个源域的丰富信息来解决未标注目标域的任务,但多源域常包含冗余或无关信息,尤其在大规模源域设置下会损害迁移性能。本文提出一种名为AutoS的多域自适应方法,可自主选择源训练样本与模型,使目标任务预测更聚焦于相关且可迁移的知识。该方法采用密度驱动的选择策略,在训练中挑选源样本,并决定哪些源模型应参与目标预测;同时,基于预训练多模态模型构建伪标签增强模块,缓解目标标签噪声并提升自监督效果。在真实世界数据集上的实验表明,该方法具有明显优势。
原文摘要 · Abstract (English)
Unsupervised multi-domain adaptation plays a key role in transfer learning by leveraging acquired rich source information from multiple source domains to solve target task from an unlabeled target domain. However, multiple source domains often contain much redundant or unrelated information which can harm transfer performance, especially when in massive-source domain settings. It is urgent to develop effective strategies for identifying and selecting the most transferable knowledge from massive source domains to address the target task. In this paper, we propose a multi-domain adaptation method named \underline{\textit{Auto}}nomous Source Knowledge \underline{\textit{S}}election (AutoS) to autonomosly select source training samples and models, enabling the prediction of target task using more relevant and transferable source information. The proposed method employs a density-driven selection strategy to choose source samples during training and to determine which source models should contribute to target prediction. Simulteneously, a pseudo-label enhancement module built on a pre-trained multimodal modal is employed to mitigate target label noise and improve self-supervision. Experiments on real-world datasets indicate the superiority of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。