在未知网络条件下,自动学习最优推理路径与模型分块方案。
Learning the Optimal Path and DNN Partition for Collaborative Edge Inference
- 将路径选择与层分配建模为带切换成本的对抗性线性多臂老虎机问题。
- 提出B-EXPUCB算法,在模拟中显著优于现有方法。
- 适合资源受限设备上的智能应用部署,尤其适用于动态网络环境。
深度神经网络(DNN)的发展推动了众多智能移动应用的兴起,但也给资源受限的移动设备带来了巨大计算挑战。为此,协同边缘推理被提出:将DNN推理任务分割为多个子任务,并分布到多个网络节点上执行。然而,现有方法通常假设已知网络参数(如节点处理速度、链路传输速率)或采用固定的节点序列。本文研究更复杂的场景:网络参数未知且需学习,同时存在多种可用网络路径。我们探索在考虑潜在安全威胁和路径切换成本的前提下,学习最优网络路径并分配DNN层到路径上的节点。首先,基于完整网络信息推导出DNN层分配的结构特性,缩小决策空间并揭示最优分配规律。随后,将不完全信息下的学习问题建模为一种新型带有切换成本的对抗性组线性贝叶斯带宽问题,其奖励由随机与对抗性过程共同生成。我们提出新算法B-EXPUCB,融合经典阻塞EXP3与LinUCB思想,证明其具有次线性遗憾。大量仿真表明,B-EXPUCB在协同边缘推理学习中性能优于现有算法。
原文摘要 · Abstract (English)
Recent advancements in Deep Neural Networks (DNNs) have catalyzed the development of numerous intelligent mobile applications and services. However, they also introduce significant computational challenges for resource-constrained mobile devices. To address this, collaborative edge inference has been proposed. This method involves partitioning a DNN inference task into several subtasks and distributing these across multiple network nodes. Despite its potential, most current approaches presume known network parameters -- like node processing speeds and link transmission rates -- or rely on a fixed sequence of nodes for processing the DNN subtasks. In this paper, we tackle a more complex scenario where network parameters are unknown and must be learned, and multiple network paths are available for distributing inference tasks. Specifically, we explore the learning problem of selecting the optimal network path and assigning DNN layers to nodes along this path, considering potential security threats and the costs of switching paths. We begin by deriving structural insights from the DNN layer assignment with complete network information, which narrows down the decision space and provides crucial understanding of optimal assignments. We then cast the learning problem with incomplete network information as a novel adversarial group linear bandits problem with switching costs, featuring rewards generation through a combined stochastic and adversarial process. We introduce a new bandit algorithm, B-EXPUCB, which combines elements of the classical blocked EXP3 and LinUCB algorithms, and demonstrate its sublinear regret. Extensive simulations confirm B-EXPUCB's superior performance in learning for collaborative edge inference over existing algorithms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。