SEVA通过单步集成增强数据提升测试时适应效率,无需额外计算开销。
SEVA: Leveraging Single-Step Ensemble of Vicinal Augmentations for Test-Time Adaptation
- 用上界损失替代熵损失,单步融合多轮增强效果
- 在多个模型和场景中实现显著性能提升,优于现有方法
- 适合对实时性要求高的部署场景,如自动驾驶
测试时适应(TTA)旨在通过推理阶段的快速模型调整来增强模型对分布偏移的鲁棒性。尽管现有方法多基于熵驱动的无监督训练并取得良好效果,但通常仅进行一轮熵训练,难以充分挖掘可靠样本的潜力,制约了适应效率。本文发现,数据增强策略能有效释放可靠样本的潜力,但其带来的计算成本迅速上升,阻碍了实时应用。为此,我们提出一种新型TTA方法——单步集成邻近增强(SEVA),可在不增加计算负担的前提下利用数据增强。具体而言,SEVA不显式生成新数据,而是建立理论框架分析多轮增强对模型适应的影响,并优化熵损失的上界,将多轮增强效果整合至单步优化中。进一步发现,使用上界作为损失更利于样本选择机制,能有效过滤干扰模型的有害样本。结合该高效损失与互补选择策略,SEVA可同时激发可靠样本潜力并满足TTA严格的实时性要求。在多种网络架构及挑战性测试场景下的全面实验表明,SEVA表现优异且具备广泛适应性。代码将公开。
原文摘要 · Abstract (English)
Test-Time adaptation (TTA) aims to enhance model robustness against distribution shifts through rapid model adaptation during inference. While existing TTA methods often rely on entropy-based unsupervised training and achieve promising results, the common practice of a single round of entropy training is typically unable to adequately utilize reliable samples, hindering adaptation efficiency. In this paper, we discover augmentation strategies can effectively unleash the potential of reliable samples, but the rapidly growing computational cost impedes their real-time application. To address this limitation, we propose a novel TTA approach named Single-step Ensemble of Vicinal Augmentations (SEVA), which can take advantage of data augmentations without increasing the computational burden. Specifically, instead of explicitly utilizing the augmentation strategy to generate new data, SEVA develops a theoretical framework to explore the impacts of multiple augmentations on model adaptation and proposes to optimize an upper bound of the entropy loss to integrate the effects of multiple rounds of augmentation training into a single step. Furthermore, we discover and verify that using the upper bound as the loss is more conducive to the selection mechanism, as it can effectively filter out harmful samples that confuse the model. Combining these two key advantages, the proposed efficient loss and a complementary selection strategy can simultaneously boost the potential of reliable samples and meet the stringent time requirements of TTA. The comprehensive experiments on various network architectures across challenging testing scenarios demonstrate impressive performances and the broad adaptability of SEVA. The code will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。