arXiv:2411.15844cs.LGcs.AI2024-11被引 1

对比两种领域自适应方法,发现无源域适应更优且适合实际部署。

Unveiling the Superior Paradigm: A Comparative Study of Source-Free Domain Adaptation and Unsupervised Domain Adaptation

  • 基于预测编码理论与实验,证明无源域适应优于传统方法。
  • 在分布差异大时,无源方法能有效缓解负迁移问题。
  • 提出新权重估计法,适用于数据与模型共享混合场景。

在领域自适应中,无监督领域自适应(UDA)通过源域数据对齐分布,而无源域自适应(SFDA)则利用预训练的源模型而不访问源数据。本文通过预测编码理论和多个基准数据集的大量实验,证明在真实场景下SFDA通常优于UDA。具体优势包括时间效率高、存储需求低、目标学习更精准、减少负迁移风险以及更强的抗过拟合能力。尤其当源域与目标域分布差异显著时,SFDA在缓解负迁移方面表现突出。此外,本文引入一种新的数据-模型融合场景(如部分机构提供原始数据,部分仅提供模型),发现传统方法未能充分利用该场景潜力。为此,提出一种新颖的权重估计方法,可有效将可用源数据整合进多源无源域自适应(MSFDA)框架,提升模型性能。本研究系统分析了UDA与SFDA的优劣,并为复杂现实环境中的模型适配提供了实用方案。

原文摘要 · Abstract (English)

In domain adaptation, there are two popular paradigms: Unsupervised Domain Adaptation (UDA), which aligns distributions using source data, and Source-Free Domain Adaptation (SFDA), which leverages pre-trained source models without accessing source data. Evaluating the superiority of UDA versus SFDA is an open and timely question with significant implications for deploying adaptive algorithms in practical applications. In this study, we demonstrate through predictive coding theory and extensive experiments on multiple benchmark datasets that SFDA generally outperforms UDA in real-world scenarios. Specifically, SFDA offers advantages in time efficiency, storage requirements, targeted learning objectives, reduced risk of negative transfer, and increased robustness against overfitting. Notably, SFDA is particularly effective in mitigating negative transfer when there are substantial distribution discrepancies between source and target domains. Additionally, we introduce a novel data-model fusion scenario, where data sharing among stakeholders varies (e.g., some provide raw data while others provide only models), and reveal that traditional UDA and SFDA methods do not fully exploit their potential in this context. To address this limitation and capitalize on the strengths of SFDA, we propose a novel weight estimation method that effectively integrates available source data into multi-SFDA (MSFDA) approaches, thereby enhancing model performance within this scenario. This work provides a thorough analysis of UDA versus SFDA and advances a practical approach to model adaptation across diverse real-world environments.

领域自适应无源学习模型融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。