让复杂视觉模型在边缘设备上高效运行,还能抗设备故障。
SlimEdge: Performance and Device Aware Distributed DNN Deployment on Resource-Constrained Edge Hardware
- 根据设备能力与故障概率,动态调整模型压缩策略。
- 在多重设备失效下仍保持精度和内存约束,推理速度最高快4.7倍。
- 适合部署在资源有限且不稳定的边缘计算场景,如智能摄像头网络。
分布式深度神经网络(DNN)已成为现代计算机视觉的核心,但其在资源受限的边缘设备上的部署仍受制于庞大的参数量、高计算需求以及设备故障风险。本文提出一种高效部署分布式DNN的方法,兼顾硬件限制、任务性能与部分系统故障的鲁棒性。方法结合结构化模型剪枝与多目标优化框架,根据异构设备约束动态调节网络容量,并在部署时显式考虑设备可用性和故障概率。以用于3D物体识别的多视角卷积神经网络(MVCNN)为例,通过量化各视角对分类准确率的贡献,相应分配剪枝预算。实验表明,所生成模型在多种模拟设备配置下,即使发生多个设备同时失效,仍满足用户指定的精度与内存边界。推理时间最高降低4.7倍。结果表明,性能感知、视图自适应且具备故障容错能力的压缩策略,为复杂视觉模型在分布式边缘环境中的部署提供了可行路径。
原文摘要 · Abstract (English)
Distributed deep neural networks (DNNs) have become central to modern computer vision, yet their deployment on resource-constrained edge devices remains hindered by substantial parameter counts, computational demands, and the probability of device failure. Here, we present an approach to the efficient deployment of distributed DNNs that jointly respect hardware limitations, preserve task performance, and remain robust to partial system failures. Our method integrates structured model pruning with a multi-objective optimization framework to tailor network capacity for heterogeneous device constraints, while explicitly accounting for device availability and failure probability during deployment. We demonstrate this framework using Multi-View Convolutional Neural Networks (MVCNN), a state-of-the-art architecture for 3D object recognition, by quantifying the contribution of individual views to classification accuracy and allocating pruning budgets accordingly. Experimental results show that the resulting models satisfy user-specified bounds on accuracy and memory footprint, even under multiple simultaneous device failures. The inference time is reduced by factors up to 4.7x across diverse simulated device configurations. These findings suggest that performance-aware, view-adaptive, and failure-resilient compression provides a viable pathway for deploying complex vision models in distributed edge environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。