arXiv:2501.00818cs.CV2025-01被引 1

SPARNet通过分组样本与防遗忘正则,实现持续测试时自适应的稳定性能提升。

SPARNet: Continual Test-Time Adaptation via Sample Partitioning Strategy and Anti-Forgetting Regularization

  • 按可靠性将样本分组,对可靠样本强化学习,对不可靠样本用一致性学习抑制干扰。
  • 在CIFAR10-C/100-C和ImageNet-C上连续域变化场景下准确率提升显著,优于现有方法。
  • 适合部署后面临持续环境变化的模型,如自动驾驶、医疗图像分析等实时系统。

测试时自适应(TTA)旨在模型上线后应对领域变化以提升性能。标准TTA假设目标域静态,而持续性TTA需应对一系列未知发生的领域变化,面临长期适应与灾难性遗忘挑战。简单自训练生成的伪标签质量难保,易导致错误累积。本文提出SPARNet框架,包含样本分组策略与防遗忘正则化。该策略将样本分为可靠与不可靠两类,对可靠样本强化更新,对不可靠样本通过均值教师的一致性学习降低负面影响。同时引入正则项限制关键参数过度变化,保障网络参数在长期适应中的稳定性。大量实验在CIFAR10-C、CIFAR100-C和ImageNet-C上验证了该方法在持续性TTA场景下的有效性。

原文摘要 · Abstract (English)

Test-time Adaptation (TTA) aims to improve model performance when the model encounters domain changes after deployment. The standard TTA mainly considers the case where the target domain is static, while the continual TTA needs to undergo a sequence of domain changes. This encounters a significant challenge as the model needs to adapt for the long-term and is unaware of when the domain changes occur. The quality of pseudo-labels is hard to guarantee. Noisy pseudo-labels produced by simple self-training methods can cause error accumulation and catastrophic forgetting. In this work, we propose a new framework named SPARNet which consists of two parts, sample partitioning strategy and anti-forgetting regularization. The sample partition strategy divides samples into two groups, namely reliable samples and unreliable samples. According to the characteristics of each group of samples, we choose different strategies to deal with different groups of samples. This ensures that reliable samples contribute more to the model. At the same time, the negative impacts of unreliable samples are eliminated by the mean teacher's consistency learning. Finally, we introduce a regularization term to alleviate the catastrophic forgetting problem, which can limit important parameters from excessive changes. This term enables long-term adaptation of parameters in the network. The effectiveness of our method is demonstrated in continual TTA scenario by conducting a large number of experiments on CIFAR10-C, CIFAR100-C and ImageNet-C.

测试时自适应持续学习伪标签防遗忘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。