让教师模型不动,能显著提升测试时自适应的稳定性与效果
Rethinking the Teacher-Student Framework for Test-Time Adaptation

- 用不更新权重的固执教师模型替代传统动量平均教师
- 在长序列任务上性能大幅提升,且对超参数更鲁棒
- 适用于多种模型和任务,如语义分割,改动简单有效
测试时自适应(TTA)是一种在部署阶段适应数据分布变化的策略,无需标签。现有方法普遍采用教师-学生框架,但其长期稳定性常被忽视。本文发现,即使使用指数移动平均更新教师权重,误差仍会累积,尤其在长序列中明显。我们分析了该框架中的稳定性和可塑性权衡,提出采用不更新权重的固执教师模型。实验表明,这一简单修改使TTA在多个数据集的长序列场景下性能显著提升,并增强对超参数变化的鲁棒性。该方法可无缝适配多种架构与设置,包括语义分割。代码已开源。
原文摘要 · Abstract (English)
Test-Time Adaptation (TTA) has recently emerged as a promising strategy that allows the adaptation of pre-trained models to changing data distributions at deployment time, without access to any labels. To mitigate error accumulation, researchers have widely adopted the teacher-student framework, though its long-term stability is often taken for granted. In this work, we challenge the common strategy of setting the teacher weights to an exponential moving average of the student by showing that error accumulation still occurs, although it is mostly apparent on longer sequences compared to those commonly utilized. We analyze the stability-plasticity trade-off within the teacher-student framework and propose to use an intransigent teacher that does not update its weights. Surprisingly, we show that this simple change allows TTA methods to significantly improve their performance on multiple datasets with longer scenarios and result in increased robustness to changes in hyperparameters. Finally, we show that those changes can be seamlessly and effectively applied to various architectures and experimental setups, including semantic segmentation. The code is available at https://github.com/dmn-sjk/intransigent_teacher.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。