用扩散模型加速边缘网络中的AIGC服务调度,降低延迟。
Accelerating AIGC Services with Latent Action Diffusion Scheduling in Edge Networks
- 基于潜在动作扩散生成近优任务调度决策。
- 在多资源约束下将服务延迟降低29.18%。
- 适合需要低延迟AIGC服务的边缘计算场景。
人工智能生成内容(AIGC)因其多样化创作能力而广受欢迎。现有AIGC模型主要聚焦于中心化架构下的内容质量,导致服务延迟高、用户体验差。AIGC任务负载取决于模型复杂度而非数据量,且大模型与多层编码结构带来巨大计算与内存需求,给边缘网络的建模、部署与调度带来新挑战。为此,我们建模边缘间任务卸载问题,提出一种基于潜在动作扩散的任务调度方法LAD-TS,通过扩散模型的条件生成能力与强化学习的环境交互能力,实现多边缘服务器协同,最小化服务延迟。设计了基于历史动作概率的潜在动作扩散策略,加速逼近最优决策。此外,我们构建了原型系统DEdgeAI,优化了AIGC模型部署,实测表明其服务延迟比当前五种主流平台平均缩短29.18%。代码已开源:https://github.com/ChangfuXu/DEdgeAI/
原文摘要 · Abstract (English)
Artificial Intelligence Generated Content (AIGC) has gained significant popularity for creating diverse content. Current AIGC models primarily focus on content quality within a centralized framework, resulting in a high service delay and negative user experiences. However, not only does the workload of an AIGC task depend on the AIGC model's complexity rather than the amount of data, but the large model and its multi-layer encoder structure also result in a huge demand for computational and memory resources. These unique characteristics pose new challenges in its modeling, deployment, and scheduling at edge networks. Thus, we model an offloading problem among edges for providing real AIGC services and propose LAD-TS, a novel Latent Action Diffusion-based Task Scheduling method that orchestrates multiple edge servers for expedited AIGC services. The LAD-TS generates a near-optimal offloading decision by leveraging the diffusion model's conditional generation capability and the reinforcement learning's environment interaction ability, thereby minimizing the service delays under multiple resource constraints. Meanwhile, a latent action diffusion strategy is designed to guide decision generation by utilizing historical action probability, enabling rapid achievement of near-optimal decisions. Furthermore, we develop DEdgeAI, a prototype edge system with a refined AIGC model deployment to implement and evaluate our LAD-TS method. DEdgeAI provides a real AIGC service for users, demonstrating up to 29.18% shorter service delays than the current five representative AIGC platforms. We release our open-source code at https://github.com/ChangfuXu/DEdgeAI/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。