arXiv:2507.01041cs.LGcs.AI2025-07被引 2

提出快速模型分割算法,显著降低边缘网络中AI训练延迟。

Fast AI Model Partition for Split Learning over Edge Networks

  • 将模型转为有向无环图,用最大流求解最优分割点。
  • 实测训练延迟降低最高达38.95%,算法耗时减少13倍。
  • 特别适配块结构模型,适合资源受限的边缘设备部署。

分裂学习(Split Learning, SL)是一种分布式学习范式,可通过在移动设备与边缘服务器间划分人工智能(AI)模型,支持计算密集型移动智能应用。然而,由于AI模型架构多样复杂,其模型分割问题面临挑战。本文提出一个最小化训练延迟的最优模型分割问题。通过将任意AI模型表示为有向无环图(DAG),其中层对应顶点,层间连接对应边,训练延迟作为边权重,将问题转化为DAG上的最小s-t割问题。理论分析表明两者等价,可借助最大流方法求得最优分割。针对具有块结构的模型,设计了一种低复杂度的分块分割算法,将每个重复块抽象为单一顶点以简化图结构。在配备NVIDIA Jetson设备的硬件测试平台上,实验结果表明,所提方案相比先进基线,算法运行时间最多缩短13.0倍,训练延迟最多降低38.95%。

原文摘要 · Abstract (English)

Split learning (SL) is a distributed learning paradigm that can enable computation-intensive artificial intelligence (AI) applications by partitioning AI models between mobile devices and edge servers. %fully utilizing distributed computing resources for computation-intensive mobile intelligence applications. However, the model partitioning problem in SL becomes challenging due to the diverse and complex architectures of AI models. In this paper, we formulate an optimal model partitioning problem to minimize training delay in SL. To solve the problem, we represent an arbitrary AI model as a directed acyclic graph (DAG), where the model's layers and inter-layer connections are mapped to vertices and edges, and training delays are captured as edge weights. Then, we propose a general model partitioning algorithm by transforming the problem into a minimum \textit{s-t} cut problem on the DAG. Theoretical analysis shows that the two problems are equivalent, such that the optimal model partition can be obtained via a maximum-flow method. Furthermore, taking AI models with block structures into consideration, we design a low-complexity block-wise model partitioning algorithm to determine the optimal model partition. Specifically, the algorithm simplifies the DAG by abstracting each block (i.e., a repeating component comprising multiple layers in an AI model) into a single vertex. Extensive experimental results on a hardware testbed equipped with NVIDIA Jetson devices demonstrate that the proposed solution can reduce algorithm running time by up to 13.0$\times$ and training delay by up to 38.95\%, compared to state-of-the-art baselines.

分裂学习边缘计算模型分割DAG优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。