通过细粒度缓存与协同广播,提升6G边缘网络模型下载速度。
Fine-Grained AI Model Caching and Downloading With Coordinated Multipoint Broadcasting in Multi-Cell Edge Networks
- 按参数块缓存模型,避免重复存储共享参数。
- 多点协同广播使多个用户同时接收通用参数块。
- 适合需要快速部署AI模型的边缘计算场景。
6G网络旨在支持按需下载AI模型,以满足终端用户的多样化推理需求。通过在边缘节点预先缓存模型,用户可低延迟获取所需模型进行本地推理。然而,现代AI模型体量庞大,在存储资源有限的边缘环境下,既带来缓存挑战,也使异构模型的并发无线传输变得困难。为此,本文提出一种细粒度的AI模型缓存与下载系统,利用不同任务模型通常从同一预训练模型微调而来且冻结参数的特点,实现参数重用。该系统仅缓存模型参数块(PB),消除跨模型间重复参数存储;同时引入协同多点(CoMP)广播,将通用参数块同时发送给多个用户,提升下行频谱效率。在此架构下,建立联合优化参数块缓存、节点间迁移和广播波束成形的下载延迟最小化问题。针对该难题,设计分布式多智能体学习框架,使边缘节点显式学习彼此行为的影响,促进协作;并提出数据增强方法,通过预测模型自动生成合成训练样本,提高样本效率并加速策略学习。理论分析与仿真实验验证了所提框架的优越收敛性能。
原文摘要 · Abstract (English)
6G networks are envisioned to support on-demand AI model downloading to accommodate diverse inference requirements of end users. By proactively caching models at edge nodes, users can retrieve the requested models with low latency for on-device AI inference. However, the substantial size of contemporary AI models poses significant challenges for edge caching under limited storage capacity, as well as for the concurrent delivery of heterogeneous models over wireless channels. To address these challenges, we propose a fine-grained AI model caching and downloading system that exploits parameter reusability, stemming from the common practice of fine-tuning task-specific models from a shared pre-trained model with frozen parameters. This system selectively caches model parameter blocks (PBs) at edge nodes, eliminating redundant storage of reusable parameters across different cached models. Additionally, it incorporates coordinated multipoint (CoMP) broadcasting to simultaneously deliver reusable PBs to multiple users, thereby enhancing downlink spectrum utilization. Under this arrangement, we formulate a model downloading delay minimization problem to jointly optimize PB caching, migration (among edge nodes), and broadcasting beamforming. To tackle this intractable problem, we develop a distributed multi-agent learning framework that enables edge nodes to explicitly learn mutual influence among their actions, thereby facilitating cooperation. Furthermore, a data augmentation approach is proposed to adaptively generate synthetic training samples through a predictive model, boosting sample efficiency and accelerating policy learning. Both theoretical analysis and simulation experiments validate the superior convergence performance of the proposed learning framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。