用大模型+强化学习实现6G网络自动调度,兼顾智能与适应性。
An Autonomous Network Orchestration Framework Integrating Large Language Models with Continual Reinforcement Learning

- 大模型负责高层规划,强化学习处理底层决策,分层协同。
- 在模拟中实现高效资源调度,支持动态环境持续学习。
- 适合研究6G智能网络或大模型应用的工程师与学者。
6G网络旨在实现全球覆盖、海量连接和极严苛需求。空-天-地一体化网络(SAGINs)与语义通信(SemCom)是实现这些目标的关键,但带来巨大资源编排复杂性。受机器人研究启发,本文提出一种名为自主强化协调(ARC)的框架,用于语义通信增强的SAGIN。ARC采用基于大语言模型的检索增强生成(RAG)监测服务、用户和资源,并处理数据;通过分层动作规划器(HAP)进行资源编排。该框架将编排分为两级:大模型负责高层规划,强化学习(RL)代理执行低层决策,符合混合专家(MoE)理念。大模型利用思维链(CoT)推理实现少样本学习,借助对比学习增强能力;而RL代理通过回放缓冲区管理实现持续学习,从而提升效率、准确性和适应性。仿真结果验证了ARC的有效性,并讨论了未来改进方向。
原文摘要 · Abstract (English)
6G networks aim to achieve global coverage, massive connectivity, and ultra-stringent requirements. Space-Air-Ground Integrated Networks (SAGINs) and Semantic Communication (SemCom) are essential for realizing these goals, yet they introduce considerable complexity in resource orchestration. Drawing inspiration from research in robotics, a viable solution to manage this complexity is the application of Large Language Models (LLMs). Although the use of LLMs in network orchestration has recently gained attention, existing solutions have not sufficiently addressed LLM hallucinations or their adaptation to network dynamics. To address this gap, this paper proposes a framework called Autonomous Reinforcement Coordination (ARC) for a SemCom-enabled SAGIN. This framework employs an LLM-based Retrieval-Augmented Generator (RAG) monitors services, users, and resources and processes the collected data, while a Hierarchical Action Planner (HAP) orchestrates resources. ARC decomposes orchestration into two tiers, utilizing LLMs for high-level planning and Reinforcement Learning (RL) agents for low-level decision-making, in alignment with the Mixture of Experts (MoE) concept. The LLMs utilize Chain-of-Thought (CoT) reasoning for few-shot learning, empowered by contrastive learning, while the RL agents employ replay buffer management for continual learning, thereby achieving efficiency, accuracy, and adaptability. Simulations are provided to demonstrate the effectiveness of ARC, along with a comprehensive discussion on potential future research directions to enhance and upgrade ARC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。