无需反向传播的轻量级模型自适应,适配边缘设备量化部署。
LeanTTA: A Backpropagation-Free and Stateless Approach to Quantized Test-Time Adaptation on Edge Devices
- 不依赖反向传播和历史数据,动态更新归一化统计值。
- 在ResNet18上仅用11.2MB峰值内存,误差降低15.7%。
- 适合资源受限的边缘设备,支持快速自适应与量化融合。
尽管将机器学习模型部署于边缘设备具有诸多优势,但移动平台的资源限制、环境动态性以及训练数据与真实场景数据分布差异,使部署面临挑战。现有测试时自适应方法通常内存开销大,且不兼容量化或低资源设备。为此,我们提出LeanTTA,一种无反向传播、无状态的量化测试时自适应框架,专为边缘设备设计。该方法通过无需反向传播的动态归一化统计更新,避免对大批量数据和历史数据的依赖,提升实际部署鲁棒性。首次实现部分自适应与量化模块融合带来的额外计算增益。我们在多传感器模态下验证框架有效性,结果表明性能显著优于现有先进方法:在相同条件下,错误率降低15.7%,ResNet18峰值内存仅11.2MB,且自适应速度接近正常推理耗时一个数量级。
原文摘要 · Abstract (English)
While there are many advantages to deploying machine learning models on edge devices, the resource constraints of mobile platforms, the dynamic nature of the environment, and differences between the distribution of training versus in-the-wild data make such deployments challenging. Current test-time adaptation methods are often memory-intensive and not designed to be quantization-compatible or deployed on low-resource devices. To address these challenges, we present LeanTTA, a novel backpropagation-free and stateless framework for quantized test-time adaptation tailored to edge devices. Our approach minimizes computational costs by dynamically updating normalization statistics without backpropagation, which frees LeanTTA from the common pitfall of relying on large batches and historical data, making our method robust to realistic deployment scenarios. Our approach is the first to enable further computational gains by combining partial adaptation with quantized module fusion. We validate our framework across sensor modalities, demonstrating significant improvements over state-of-the-art TTA methods, including a 15.7% error reduction, peak memory usage of only 11.2MB for ResNet18, and fast adaptation within an order-of-magnitude of normal inference speeds on-device. LeanTTA provides a robust solution for achieving the right trade offs between accuracy and system efficiency in edge deployments, addressing the unique challenges posed by limited data and varied operational conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。