arXiv:2510.01649cs.LGcs.AI2025-10

无需源域数据,实现跨域持续学习的高效鲁棒方法

Source-Free Cross-Domain Continual Learning

  • 利用预训练模型与视觉语言模型协同,不依赖源域标签
  • 通过频率感知增强生成抗噪声伪标签样本,提升泛化能力
  • 适合隐私敏感场景,尤其适用于无源数据访问的持续学习任务

现有跨域持续学习方法虽能应对领域偏移下的流式任务,但需完全标注的源域数据,限制了其在隐私约束环境中的应用。本文提出源域自由的跨域持续学习框架REFEREE,完全禁止使用源域样本。该方法基于源域预训练模型与大规模视觉-语言模型的协同,克服仅依赖预训练模型时的泛化不足问题。通过频率感知提示技术,抑制高频分量、增强低频分量,生成对抗噪声伪标签的频率感知增强样本。针对伪标签噪声问题,采用不确定性加权策略,根据预测均值和协方差矩阵进行加权,减轻噪声影响。同时,通过核线性判别分析(KLDA)缓解灾难性遗忘,冻结主干网络,仅用随机核方法指导的线性判别分析完成分类。大量实验验证了该方法的优越性,在未访问源域样本的情况下显著优于已有方法。

原文摘要 · Abstract (English)

Although existing cross-domain continual learning approaches successfully address many streaming tasks having domain shifts, they call for a fully labeled source domain hindering their feasibility in the privacy constrained environments. This paper goes one step ahead with the problem of source-free cross-domain continual learning where the use of source-domain samples are completely prohibited. We propose the idea of rehearsal-free frequency-aware dynamic prompt collaborations (REFEREE) to cope with the absence of labeled source-domain samples in realm of cross-domain continual learning. REFEREE is built upon a synergy between a source-pre-trained model and a large-scale vision-language model, thus overcoming the problem of sub-optimal generalizations when relying only on a source pre-trained model. The domain shift problem between the source domain and the target domain is handled by a frequency-aware prompting technique encouraging low-frequency components while suppressing high-frequency components. This strategy generates frequency-aware augmented samples, robust against noisy pseudo labels. The noisy pseudo-label problem is further addressed with the uncertainty-aware weighting strategy where the mean and covariance matrix are weighted by prediction uncertainties, thus mitigating the adverse effects of the noisy pseudo label. Besides, the issue of catastrophic forgetting (CF) is overcome by kernel linear discriminant analysis (KLDA) where the backbone network is frozen while the classification is performed using the linear discriminant analysis approach guided by the random kernel method. Our rigorous numerical studies confirm the advantage of our approach where it beats prior arts having access to source domain samples with significant margins.

持续学习跨域迁移隐私保护伪标签

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。