arXiv:2409.05303cs.LGcs.AI2024-09被引 7

针对移动端生成式AI模型部署资源紧张问题,提出优化算法实现高效资源调度。

Resource-Efficient Generative AI Model Deployment in Mobile Edge Networks

  • 基于模型异构特性构建优化模型,统筹考虑存储、显存与切换延迟。
  • 仿真验证可降低整体成本,提升资源利用率与服务响应速度。
  • 适合关注边缘计算中生成式AI落地的开发者与系统架构师。

生成式人工智能内容(AIGC)的快速发展标志着内容创作的新纪元。相比云端方案,边缘服务器在降低服务延迟和回传流量负载方面具有显著优势。然而,边缘端资源有限,难以支撑生成式AI模型的部署。本文通过分析典型生成式AI模型的资源与延迟需求,发现存储、GPU内存消耗以及预加载阶段的I/O延迟(体现为模型切换延迟)是关键瓶颈,且各模型间差异显著。这些多维耦合因素使边缘部署决策复杂化。为此,本文提出一种协同边缘-云框架,将模型异构特性纳入考量,构建边缘模型部署优化问题,并设计模型级决策选择算法。该方法支持资源池化共享,优化了资源消耗与延迟之间的权衡。仿真结果验证了所提算法优于基线方案,能有效降低总体开销,提供特征感知的部署决策。

原文摘要 · Abstract (English)

The surging development of Artificial Intelligence-Generated Content (AIGC) marks a transformative era of the content creation and production. Edge servers promise attractive benefits, e.g., reduced service delay and backhaul traffic load, for hosting AIGC services compared to cloud-based solutions. However, the scarcity of available resources on the edge pose significant challenges in deploying generative AI models. In this paper, by characterizing the resource and delay demands of typical generative AI models, we find that the consumption of storage and GPU memory, as well as the model switching delay represented by I/O delay during the preloading phase, are significant and vary across models. These multidimensional coupling factors render it difficult to make efficient edge model deployment decisions. Hence, we present a collaborative edge-cloud framework aiming to properly manage generative AI model deployment on the edge. Specifically, we formulate edge model deployment problem considering heterogeneous features of models as an optimization problem, and propose a model-level decision selection algorithm to solve it. It enables pooled resource sharing and optimizes the trade-off between resource consumption and delay in edge generative AI model deployment. Simulation results validate the efficacy of the proposed algorithm compared with baselines, demonstrating its potential to reduce overall costs by providing feature-aware model deployment decisions.

边缘计算生成式AI资源调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。