arXiv:2505.00321cs.NIcs.LG2025-05被引 11

将大模型部署到6G边缘,实现实时智能服务

Edge Large AI Models: Revolutionizing 6G Networks

  • 通过模型拆分与分布式部署,让大模型在边缘运行
  • 提出协同微调与全参数训练框架,降低资源消耗
  • 适合研究6G智能通信与边缘计算的学者

大型人工智能模型(LAMs)具备解决各类现实问题的人类级能力,是多领域、多模态专家的体现。借助地理分散的边缘设备的通信与计算能力,边缘LAM成为支撑6G中实时智能服务的关键技术。与传统仅支持单一任务的小模型边缘AI不同,边缘LAM需要对大模型进行分解与分布式部署,并支持高度泛化和多样化的任务。然而,受限于无线网络中的通信、计算和存储资源,大模型庞大的可训练参数量和显著的通信开销,构成了其实际部署的重大挑战。本文从模型分解与资源管理角度,探讨边缘LAM的机遇与挑战。具体提出协同微调与全参数训练框架,以及基于微服务的推理架构,以提升边缘LAM在无线网络中的部署效率。此外,研究了边缘LAM在空口设计中的应用,聚焦信道预测与波束赋形。这些创新框架与应用为推进6G技术提供了重要洞见与解决方案。

原文摘要 · Abstract (English)

Large artificial intelligence models (LAMs) possess human-like abilities to solve a wide range of real-world problems, exemplifying the potential of experts in various domains and modalities. By leveraging the communication and computation capabilities of geographically dispersed edge devices, edge LAM emerges as an enabling technology to empower the delivery of various real-time intelligent services in 6G. Unlike traditional edge artificial intelligence (AI) that primarily supports a single task using small models, edge LAM is featured by the need of the decomposition and distributed deployment of large models, and the ability to support highly generalized and diverse tasks. However, due to limited communication, computation, and storage resources over wireless networks, the vast number of trainable neurons and the substantial communication overhead pose a formidable hurdle to the practical deployment of edge LAMs. In this paper, we investigate the opportunities and challenges of edge LAMs from the perspectives of model decomposition and resource management. Specifically, we propose collaborative fine-tuning and full-parameter training frameworks, alongside a microservice-assisted inference architecture, to enhance the deployment of edge LAM over wireless networks. Additionally, we investigate the application of edge LAM in air-interface designs, focusing on channel prediction and beamforming. These innovative frameworks and applications offer valuable insights and solutions for advancing 6G technology.

6G边缘智能大模型通信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。