arXiv:2501.15240cs.LGcs.AI2025-01被引 4

针对同型号边缘设备性能差异,提出硬件感知压缩框架,提升部署效率。

Hardware-Aware DNN Compression for Homogeneous Edge Devices

  • 按设备特性聚类,用代理评估替代实测,大幅降低调优成本。
  • 在ResNet50上实现1.0G FLOPs时2.86倍加速,平均推理延迟更低。
  • 适合大规模同型边缘设备的高效模型部署,尤其适用资源受限场景。

在同型号边缘设备(由制造商定义相同型号的设备)上部署深度神经网络(DNN)通常假设设备间性能一致。然而,设备广泛部署后,因用户配置、环境条件、制造差异、电池老化等因素,各设备实际性能出现差异。现有DNN压缩方法未考虑此场景,难以在所有设备上保证良好压缩效果。为此,本文提出面向同型边缘设备的硬件感知剪枝(HDAP),一种专为同型边缘设备设计的硬件感知压缩框架,旨在实现压缩模型在所有设备上的最优平均性能。为应对数千甚至数百万同型设备的硬件感知评估耗时问题,HDAP将所有设备划分为若干设备集群,显著减少需评估设备数量,并采用代理评估代替实时硬件评估。在ImageNet数据集上对ResNet50和MobileNetV1的实验表明,与现有最优方法相比,HDAP始终实现更低的平均推理延迟,在同型设备集群上获得显著加速收益(如在1.0G FLOPs时,ResNet50达到2.86×加速)。该方法为同型边缘设备提供了可扩展、高性能的DNN部署解决方案。

原文摘要 · Abstract (English)

Deploying deep neural networks (DNNs) across homogeneous edge devices (the devices with the same SKU labeled by the manufacturer) often assumes identical performance among them. However, once a device model is widely deployed, the performance of each device becomes different after a period of running. This is caused by the differences in user configurations, environmental conditions, manufacturing variances, battery degradation, etc. Existing DNN compression methods have not taken this scenario into consideration and can not guarantee good compression results in all homogeneous edge devices. To address this, we propose Homogeneous-Device Aware Pruning (HDAP), a hardware-aware DNN compression framework explicitly designed for homogeneous edge devices, aiming to achieve optimal average performance of the compressed model across all devices. To deal with the difficulty of time-consuming hardware-aware evaluations for thousands or millions of homogeneous edge devices, HDAP partitions all the devices into several device clusters, which can dramatically reduce the number of devices to evaluate and use the surrogate-based evaluation instead of hardware evaluation in real-time. Experiments on ResNet50 and MobileNetV1 with the ImageNet dataset show that HDAP consistently achieves lower average inference latency compared with state-of-the-art methods, with substantial speedup gains (e.g., 2.86 $\times$ speedup at 1.0G FLOPs for ResNet50) on the homogeneous device clusters. HDAP offers an effective solution for scalable, high-performance DNN deployment methods for homogeneous edge devices.

边缘计算模型压缩硬件感知剪枝

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。