arXiv:2511.18468cs.LGcs.CV2025-11

提出双教师框架,让模型快速适应新场景并记住旧知识。

SloMo-Fast: Slow-Momentum and Fast-Adaptive Teachers for Source-Free Continual Test-Time Adaptation

  • 用慢教师保记忆、快教师速适应,双师协同提升泛化能力。
  • 在11个测试场景中超越现有方法,尤其在反复出现的领域中表现优异。
  • 无需源数据,适合隐私敏感和资源受限场景,适用于持续学习应用。

持续测试时自适应(CTTA)对于部署在不断变化的真实世界中的模型至关重要。现有方法通常依赖源数据或原型,在隐私敏感和资源受限环境下难以应用。尽管部分方法尝试缓解灾难性遗忘,但往往无法长期保留已遇领域的特定知识。此外,其适应速度较慢,导致错误累积,使错误在有效适应前传播。为此,我们提出SloMo-Fast:一种无源数据、双教师架构的CTTA框架,实现快速适应与良好泛化。该框架包含两个互补的教师:慢教师遗忘缓慢,保留过往领域的长期知识以保障鲁棒泛化;快教师能迅速适应新领域,并整合跨领域知识。实验表明,SloMo-Fast在循环测试时自适应(Cyclic-TTA)基准及另外十个CTTA设置中均显著优于现有先进方法,展现出在重复出现、持续演化的领域中兼具适应性与泛化性的强大能力。

原文摘要 · Abstract (English)

Continual Test-Time Adaptation (CTTA) is crucial for deploying models in real-world applications with unseen, evolving target domains. Existing CTTA methods, however, often rely on source data or prototypes, limiting their applicability in privacy-sensitive and resource-constrained settings. Although several methods attempt to mitigate catastrophic forgetting, they often fail to preserve long-term domain-specific knowledge across many domain shifts. Moreover, their relatively slow adaptation rates during domain transitions can cause error accumulation, allowing mistakes to propagate before effective adaptation occurs. To address these challenges, we propose SloMo-Fast, a source-free, dual-teacher CTTA framework designed for enhanced quick adaptability and generalization. It includes two complementary teachers: the Slow-Teacher, which exhibits slow forgetting and retains long-term knowledge of previously encountered domains to ensure robust generalization, and the Fast-Teacher rapidly adapts to new domains while accumulating and integrating knowledge across them. This framework preserves knowledge of past domains and adapts efficiently to new ones. Our extensive experiments show that SloMo-Fast consistently outperforms state-of-the-art methods across Cyclic Test-Time Adaptation (Cyclic-TTA), a CTTA benchmark that simulates recurring domain shifts, along with ten other CTTA settings, highlighting its ability to both adapt and generalize across evolving, revisited domains.

持续学习测试时自适应双教师无源数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。