边端协同推理提升多视角分类效率,显著降低通信开销。
Edge-device Collaborative Computing for Multi-view Classification
- 设计选择性协同推理机制,动态分配计算与数据融合
- 通信量减少18%~74%,准确率仍超90%
- 适合资源受限的物联网多视角场景
随着物联网设备普及和深度学习发展,将传统由云端处理的深度学习任务推向网络边缘,可加快响应速度、减少带宽消耗并缓解隐私问题。然而,仍面临两大挑战:如何在资源受限设备上满足深度学习高算力需求;如何利用多源空间相关数据提升模型效果。为此,本文探索边端协同推理,通过不同方式拆分计算、融合数据,实现边缘节点与终端设备协作。相比传统集中式与分布式方案,提出选择性方案以减少数据冗余。以具有重叠视场的感知节点多视角分类为场景,对比了准确性、节点计算开销、通信开销、推理延迟、鲁棒性及抗噪性等指标。实验表明,选择性协同方案可在多个性能间实现良好权衡,部分方案相较集中式推理传输数据量减少18%至74%,同时保持推理准确率高于90%。
原文摘要 · Abstract (English)
Motivated by the proliferation of Internet-of-Thing (IoT) devices and the rapid advances in the field of deep learning, there is a growing interest in pushing deep learning computations, conventionally handled by the cloud, to the edge of the network to deliver faster responses to end users, reduce bandwidth consumption to the cloud, and address privacy concerns. However, to fully realize deep learning at the edge, two main challenges still need to be addressed: (i) how to meet the high resource requirements of deep learning on resource-constrained devices, and (ii) how to leverage the availability of multiple streams of spatially correlated data, to increase the effectiveness of deep learning and improve application-level performance. To address the above challenges, we explore collaborative inference at the edge, in which edge nodes and end devices share correlated data and the inference computational burden by leveraging different ways to split computation and fuse data. Besides traditional centralized and distributed schemes for edge-end device collaborative inference, we introduce selective schemes that decrease bandwidth resource consumption by effectively reducing data redundancy. As a reference scenario, we focus on multi-view classification in a networked system in which sensing nodes can capture overlapping fields of view. The proposed schemes are compared in terms of accuracy, computational expenditure at the nodes, communication overhead, inference latency, robustness, and noise sensitivity. Experimental results highlight that selective collaborative schemes can achieve different trade-offs between the above performance metrics, with some of them bringing substantial communication savings (from 18% to 74% of the transmitted data with respect to centralized inference) while still keeping the inference accuracy well above 90%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。