arXiv:2410.03688cs.NIcs.AI2024-10被引 16

用大模型代理实现6G物理层任务自动化,提升系统智能调控能力

LLM Agents as 6G Orchestrator: A Paradigm for Task-Oriented Physical-Layer Automation

  • 分两阶段持续预训练与微调,构建通用与专用大模型
  • 基于语义检索的推理框架,有效利用通信功能组件
  • 在物理层任务分解中验证了方案可行性与高效性

生成式预训练模型的发展正推动技术范式从聊天机器人向更复杂的代理系统演进。将6G系统与大语言模型(LLM)代理及数字孪生(DT)结合,有望实现对具备原生AI服务和感知能力等新特性的复杂通信系统的智能管理。通过6G代理,基站可理解上层动态任务的传输需求,并自动编排最优系统流程;借助来自6G DT的持续反馈进行强化学习,最终提升实际系统性能。不同于面向通用应用的现有LLM代理,面向6G的代理需在大量专家知识支持下完成高精度、严苛的规划,因此必须从模型训练到部署进行专门设计。本文提出一种构建面向任务的6G LLM代理的综合性新方法:首先采用两阶段持续预训练与微调策略,建立领域基础模型及多种专用专家模型以适配不同应用场景;进一步提出基于语义检索的新型推理框架,以复用已有通信相关功能。在物理层任务分解等典型任务上的实验结果表明该范式的可行性与有效性。

原文摘要 · Abstract (English)

The rapid advancement in generative pre-training models is propelling a paradigm shift in technological progression from basic applications such as chatbots towards more sophisticated agent-based systems. It is with huge potential and necessity that the 6G system be combined with the copilot of large language model (LLM) agents and digital twins (DT) to manage the highly complicated communication system with new emerging features such as native AI service and sensing. With the 6G-oriented agent, the base station could understand the transmission requirements of various dynamic upper-layer tasks, automatically orchestrate the optimal system workflow. Through continuously get feedback from the 6G DT for reinforcement, the agents can finally raise the performance of practical system accordingly. Differing from existing LLM agents designed for general application, the 6G-oriented agent aims to make highly rigorous and precise planning with a vast amount of extra expert knowledge, which inevitably requires a specific system design from model training to implementation. This paper proposes a novel comprehensive approach for building task-oriented 6G LLM agents. We first propose a two-stage continual pre-training and fine-tuning scheme to build the field basic model and diversities of specialized expert models for meeting the requirements of various application scenarios. Further, a novel inference framework based on semantic retrieval for leveraging the existing communication-related functions is proposed. Experiment results of exemplary tasks, such as physical-layer task decomposition, show the proposed paradigm's feasibility and effectiveness.

6G大模型代理物理层自动化数字孪生

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。