arXiv:2511.15276cs.LG2025-11NeurIPS被引 4

让模型在极低频更新下仍保持高精度,适合边缘设备实时推理。

SNAP: Low-Latency Test-Time Adaptation with Sparse Updates

  • 只用1%数据流进行更新,通过代表性样本记忆实现高效适应。
  • 相比原方法延迟降低93.12%,准确率损失小于3.3%。
  • 适用于对延迟敏感的边缘部署场景,如移动设备和物联网。

测试时自适应(TTA)利用无标签测试数据调整模型以应对动态分布偏移。然而,现有方法依赖频繁更新与高计算开销,难以用于资源受限的边缘环境。为此,我们提出SNAP,一种稀疏化TTA框架,显著降低适应频率与数据用量,同时保持高精度。SNAP在仅基于1%输入数据流更新时仍能保持竞争力,展现出对稀疏更新的鲁棒性。其核心包含两个组件:(i) 类与域代表性记忆(CnDRM),用于识别并存储兼具类别与域特征代表性的少量样本,支持有限数据下的高效适配;(ii) 推理时批次感知记忆归一化(IoBMN),通过这些代表性样本动态调整推理时的归一化统计量,实现对变化目标域的有效对齐。集成五种主流TTA算法后,SNAP将延迟降低高达93.12%,且准确率下降始终低于3.3%,适用范围覆盖1%至50%的适应率。表明其在边缘设备上服务低延迟应用的巨大潜力。代码已开源:https://github.com/chahh9808/SNAP。

原文摘要 · Abstract (English)

Test-Time Adaptation (TTA) adjusts models using unlabeled test data to handle dynamic distribution shifts. However, existing methods rely on frequent adaptation and high computational cost, making them unsuitable for resource-constrained edge environments. To address this, we propose SNAP, a sparse TTA framework that reduces adaptation frequency and data usage while preserving accuracy. SNAP maintains competitive accuracy even when adapting based on only 1% of the incoming data stream, demonstrating its robustness under infrequent updates. Our method introduces two key components: (i) Class and Domain Representative Memory (CnDRM), which identifies and stores a small set of samples that are representative of both class and domain characteristics to support efficient adaptation with limited data; and (ii) Inference-only Batch-aware Memory Normalization (IoBMN), which dynamically adjusts normalization statistics at inference time by leveraging these representative samples, enabling efficient alignment to shifting target domains. Integrated with five state-of-the-art TTA algorithms, SNAP reduces latency by up to 93.12%, while keeping the accuracy drop below 3.3%, even across adaptation rates ranging from 1% to 50%. This demonstrates its strong potential for practical use on edge devices serving latency-sensitive applications. The source code is available at https://github.com/chahh9808/SNAP.

测试时自适应边缘计算稀疏更新低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。