arXiv:2409.09753cs.CVcs.AI2024-09被引 2

让神经网络实时识别并适应新噪声,省电又高效。

DARDA: Domain-Aware Real-Time Dynamic Neural Network Adaptation

  • 预训练多种噪声的隐空间表示,匹配对应子网络
  • 无需标注,在线适配新噪声,准确率提升4.4%~10.4%
  • 适合边缘设备部署,能耗降低1.74倍,内存节省2.64倍

测试时自适应(TTA)已成为缓解深度神经网络在输入受污染/噪声影响时性能下降的实用方案。现有方法持续调整网络,因缺乏监督导致误差累积,资源消耗过高。本文提出领域感知实时动态自适应(DARDA),通过预学习部分噪声类型的隐空间表示,并为每种噪声关联一个专用子网络状态。部署后,DARDA通过估计当前噪声的隐表示,选择最接近的子网络,并动态调整网络状态以匹配该噪声。该方法更省资源,可快速应对新分布的噪声,且无需大量输入数据。在Raspberry Pi与NVIDIA Jetson Nano上实验表明,相比当前最优方法,能量消耗降低1.74倍,平均缓存内存占用减少2.64倍,同时在CIFAR-10、CIFAR-100和TinyImageNet上分别提升准确率10.4%、5.7%和4.4%。

原文摘要 · Abstract (English)

Test Time Adaptation (TTA) has emerged as a practical solution to mitigate the performance degradation of Deep Neural Networks (DNNs) in the presence of corruption/ noise affecting inputs. Existing approaches in TTA continuously adapt the DNN, leading to excessive resource consumption and performance degradation due to accumulation of error stemming from lack of supervision. In this work, we propose Domain-Aware Real-Time Dynamic Adaptation (DARDA) to address such issues. Our key approach is to proactively learn latent representations of some corruption types, each one associated with a sub-network state tailored to correctly classify inputs affected by that corruption. After deployment, DARDA adapts the DNN to previously unseen corruptions in an unsupervised fashion by (i) estimating the latent representation of the ongoing corruption; (ii) selecting the sub-network whose associated corruption is the closest in the latent space to the ongoing corruption; and (iii) adapting DNN state, so that its representation matches the ongoing corruption. This way, DARDA is more resource efficient and can swiftly adapt to new distributions caused by different corruptions without requiring a large variety of input data. Through experiments with two popular mobile edge devices - Raspberry Pi and NVIDIA Jetson Nano - we show that DARDA reduces energy consumption and average cache memory footprint respectively by 1.74x and 2.64x with respect to the state of the art, while increasing the performance by 10.4%, 5.7% and 4.4% on CIFAR-10, CIFAR-100 and TinyImagenet.

模型自适应边缘计算实时推理降噪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。