arXiv:2505.14511cs.CV2025-05NeurIPS被引 8

用多个专用模型应对持续变化的测试环境,避免遗忘旧领域。

ReservoirTTA: Prolonged Test-time Adaptation for Evolving and Recurring Domains

  • 构建动态模型池,按输入风格自动匹配最适专用模型。
  • 在多类数据集上实现稳定性能,比现有方法提升显著。
  • 适合长期运行中面临频繁或渐进性数据漂移的任务。

本文提出ReservoirTTA,一种针对持续变化测试域(包括重复出现和渐进演化)的长效测试时自适应框架。其核心是维护一个包含领域专用模型的模型池——通过在线聚类输入样本的风格特征来检测新领域,并将样本路由至相应专用模型,实现领域特定自适应。该多模型策略克服了单模型适应中的灾难性遗忘、跨域干扰与误差累积等关键缺陷,在持续非平稳测试分布下保持鲁棒稳定。理论分析揭示了控制参数方差、防止模型坍缩的关键组件,且插件式模块有效缓解对先前领域知识的遗忘。在场景级损坏基准(ImageNet-C、CIFAR-10/100-C)、对象级风格迁移(DomainNet-126、PACS)及语义分割(Cityscapes→ACDC)上的大量实验表明,ReservoirTTA显著提升适应精度,并在长期反复或连续演变的域转移中保持稳定表现,优于当前最优方法。

原文摘要 · Abstract (English)

This paper introduces ReservoirTTA, a novel plug-in framework designed for prolonged test-time adaptation (TTA) in scenarios where the test domain continuously shifts over time, including cases where domains recur or evolve gradually. At its core, ReservoirTTA maintains a reservoir of domain-specialized models -- an adaptive test-time model ensemble -- that both detects new domains via online clustering over style features of incoming samples and routes each sample to the appropriate specialized model, and thereby enables domain-specific adaptation. This multi-model strategy overcomes key limitations of single model adaptation, such as catastrophic forgetting, inter-domain interference, and error accumulation, ensuring robust and stable performance on sustained non-stationary test distributions. Our theoretical analysis reveals key components that bound parameter variance and prevent model collapse, while our plug-in TTA module mitigates catastrophic forgetting of previously encountered domains. Extensive experiments on scene-level corruption benchmarks (ImageNet-C, CIFAR-10/100-C), object-level style shifts (DomainNet-126, PACS), and semantic segmentation (Cityscapes->ACDC) covering recurring and continuously evolving domain shifts -- show that ReservoirTTA substantially improves adaptation accuracy and maintains stable performance across prolonged, recurring shifts, outperforming state-of-the-art methods. Our code is publicly available at https://github.com/LTS5/ReservoirTTA.

测试时自适应模型池持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。