解决视觉模型在持续数据漂移下的实时自适应问题
Continual Test-Time Adaptation in Computer Vision: Methods, Benchmarks, and Future Directions

- 提出三类自适应方法:优化、参数高效与架构改进
- 实测验证了不同方法在长期适应中的稳定性与遗忘控制能力
- 适合关注模型部署鲁棒性的研究者与工程师
深度神经网络在训练与测试数据分布一致时表现优异,但在真实场景中,数据分布会持续变化。持续测试时自适应(CTTA)通过在不访问源数据或带标签目标数据的情况下,实时调整预训练模型以应对非平稳目标分布,同时缓解源知识灾难性遗忘和噪声伪标签导致的误差累积问题。本文系统定义了CTTA问题,分析了不同评估协议下的持续域偏移模式,提出分层分类体系,将现有方法分为三类:基于优化策略(熵最小化、伪标签、参数恢复)、参数高效方法(归一化层适配、自适应参数选择)和架构型方法(师生框架、适配器、视觉提示、掩码建模)。系统回顾各类别代表性方法,在标准设置下进行对比基准测试与实验结果分析。最后讨论当前方法局限,展望基础模型与黑箱系统自适应等新兴方向,为未来研究提供路线图。
原文摘要 · Abstract (English)
Deep neural nets achieve remarkable performance when training and test data share the same distribution, but this assumption frequently breaks in real-world deployment, where data undergoes continual distributional shifts. Continual Test-Time Adaptation (CTTA) addresses this challenge by adapting pretrained models to non-stationary target distributions on-the-fly, without access to source data or labeled targets, while mitigating two critical failure modes: catastrophic forgetting of source knowledge and error accumulation from noisy pseudo-labels over extended time horizons. In this comprehensive survey, we formally define the CTTA problem, analyze the diverse continual domain shift patterns that characterize different evaluation protocols, and propose a hierarchical taxonomy that categorizes existing methods into three families: optimization-based strategies (entropy minimization, pseudo-labeling, parameter restoration), parameter-efficient methods (normalization layer adaptation, adaptive parameter selection), and architecture-based approaches (teacher-student frameworks, adapters, visual prompting, masked modeling). We systematically review representative methods within each category and present comparative benchmarks and experimental results across standard evaluation settings. Finally, we discuss the limitations of current approaches and highlight emerging research directions, including the adaptation of foundation models and black-box systems, thereby providing a roadmap for future research in robust continual test-time adaptation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。