arXiv:2502.20677cs.LG2025-02被引 3

提出聚焦关键层的低内存测试时持续自适应方法,适合资源受限设备。

FoCTTA: Low-Memory Continual Test-Time Adaptation with Focus

  • 只更新少数敏感表征层,避免全量批归一化层更新
  • 在相同内存下,准确率提升4.5%~14.8%(三数据集)
  • 适用于边缘计算、物联网等低内存场景

测试时持续适应(CTTA)对提升物联网应用的智能水平至关重要。现有方法通常更新所有批归一化(BN)层,存在双重内存瓶颈:一是依赖大批次以维持BN性能,二是需存储所有BN层激活值用于反向传播。两者导致内存开销过大,难以部署于物联网设备。本文提出低内存的FoCTTA策略,通过自动识别并仅适应少数漂移敏感的表征层,替代全量BN更新。该方法无需大批次,且仅存储关键层激活,显著降低内存需求。实验表明,在相同内存约束下,FoCTTA在CIFAR10-C、CIFAR100-C和ImageNet-C上分别提升准确率4.5%、4.9%和14.8%;在不同批次下,平均内存减少3倍,同时准确率提升8.1%、3.6%和0.2%。

原文摘要 · Abstract (English)

Continual adaptation to domain shifts at test time (CTTA) is crucial for enhancing the intelligence of deep learning enabled IoT applications. However, prevailing TTA methods, which typically update all batch normalization (BN) layers, exhibit two memory inefficiencies. First, the reliance on BN layers for adaptation necessitates large batch sizes, leading to high memory usage. Second, updating all BN layers requires storing the activations of all BN layers for backpropagation, exacerbating the memory demand. Both factors lead to substantial memory costs, making existing solutions impractical for IoT devices. In this paper, we present FoCTTA, a low-memory CTTA strategy. The key is to automatically identify and adapt a few drift-sensitive representation layers, rather than blindly update all BN layers. The shift from BN to representation layers eliminates the need for large batch sizes. Also, by updating adaptation-critical layers only, FoCTTA avoids storing excessive activations. This focused adaptation approach ensures that FoCTTA is not only memory-efficient but also maintains effective adaptation. Evaluations show that FoCTTA improves the adaptation accuracy over the state-of-the-arts by 4.5%, 4.9%, and 14.8% on CIFAR10-C, CIFAR100-C, and ImageNet-C under the same memory constraints. Across various batch sizes, FoCTTA reduces the memory usage by 3-fold on average, while improving the accuracy by 8.1%, 3.6%, and 0.2%, respectively, on the three datasets.

测试时适应低内存边缘计算持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。