arXiv:2509.09935cs.CV2025-09

无需源数据,用自监督模型持续适配目标域,性能超越现有方法。

SCoDA: Self-supervised Continual Domain Adaptation

  • 用自监督预训练教师模型替代有监督预训练,避免依赖源数据。
  • 引入空间相似性损失,保留特征流形的几何结构信息。
  • 适合无源数据、需持续学习的跨域迁移场景,如工业视觉部署。

无源域适应(SFDA)旨在不访问源域数据的情况下将模型适配到目标域。现有方法通常基于全监督预训练的源模型,通过实例级特征对齐进行知识蒸馏,但这类方法依赖L2归一化特征向量间的余弦相似度,无意中丢失了源模型潜在流形的关键几何信息。本文提出自监督持续域适应(SCoDA),实现两大改进:首先,以完全通过自监督学习(SSL)预训练的教师模型初始化框架,摆脱对监督预训练的依赖;其次,将几何流形对齐原则引入SFDA设置。学生模型采用复合目标函数,结合实例级特征匹配与空间相似性损失。为缓解灾难性遗忘,教师参数通过学生参数的指数移动平均(EMA)更新。在基准数据集上的大量实验表明,SCoDA显著优于当前最先进的SFDA方法。

原文摘要 · Abstract (English)

Source-Free Domain Adaptation (SFDA) addresses the challenge of adapting a model to a target domain without access to the data of the source domain. Prevailing methods typically start with a source model pre-trained with full supervision and distill the knowledge by aligning instance-level features. However, these approaches, relying on cosine similarity over L2-normalized feature vectors, inadvertently discard crucial geometric information about the latent manifold of the source model. We introduce Self-supervised Continual Domain Adaptation (SCoDA) to address these limitations. We make two key departures from standard practice: first, we avoid the reliance on supervised pre-training by initializing the proposed framework with a teacher model pre-trained entirely via self-supervision (SSL). Second, we adapt the principle of geometric manifold alignment to the SFDA setting. The student is trained with a composite objective combining instance-level feature matching with a Space Similarity Loss. To combat catastrophic forgetting, the teacher's parameters are updated via an Exponential Moving Average (EMA) of the student's parameters. Extensive experiments on benchmark datasets demonstrate that SCoDA significantly outperforms state-of-the-art SFDA methods.

域适应自监督持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。