arXiv:2503.03391cs.LGcs.AI2025-03被引 23

用多智能体强化学习优化空地网络任务卸载,省电又保延迟。

Multi-Agent DRL for Queue-Aware Task Offloading in Hierarchical MEC-Enabled Air-Ground Networks

  • 将无人机轨迹、资源分配和任务卸载联合建模为多智能体马尔可夫决策过程。
  • 在真实场景模拟中,比基线方案节能32%以上,且满足队列延迟约束。
  • 适合研究6G边缘计算、无人机协同系统或智能资源调度的科研人员。

面向6G的空地融合移动边缘计算(MEC)网络通过无人机(UAVs)和高空平台站(HAPS)为地面物联网设备(IoTDs)提供动态服务。这些设备支撑多媒体与元宇宙等实时应用,对计算资源和低时延、队列管理有严格要求。由于能源与算力有限,需依赖空中基站进行任务卸载,形成多层MEC架构。本文针对该系统中的整体能耗最小化问题,联合优化无人机轨迹、计算资源分配与队列感知的任务卸载决策。由于系统非凸、非线性,传统方法失效。我们将其重构为具有连续动作空间和异构智能体的多智能体马尔可夫决策过程,并提出一种基于贝塔分布的多智能体近端策略优化(MAPPO-BD)算法求解。大量仿真表明,该算法显著优于基准方案,在满足队列延迟与边缘计算约束的前提下,实现更优的能耗节省与资源管理效率。

原文摘要 · Abstract (English)

Mobile edge computing (MEC)-enabled air-ground networks are a key component of 6G, employing aerial base stations (ABSs) such as unmanned aerial vehicles (UAVs) and high-altitude platform stations (HAPS) to provide dynamic services to ground IoT devices (IoTDs). These IoTDs support real-time applications (e.g., multimedia and Metaverse services) that demand high computational resources and strict quality of service (QoS) guarantees in terms of latency and task queue management. Given their limited energy and processing capabilities, IoTDs rely on UAVs and HAPS to offload tasks for distributed processing, forming a multi-tier MEC system. This paper tackles the overall energy minimization problem in MEC-enabled air-ground integrated networks (MAGIN) by jointly optimizing UAV trajectories, computing resource allocation, and queue-aware task offloading decisions. The optimization is challenging due to the nonconvex, nonlinear nature of this hierarchical system, which renders traditional methods ineffective. We reformulate the problem as a multi-agent Markov decision process (MDP) with continuous action spaces and heterogeneous agents, and propose a novel variant of multi-agent proximal policy optimization with a Beta distribution (MAPPO-BD) to solve it. Extensive simulations show that MAPPO-BD outperforms baseline schemes, achieving superior energy savings and efficient resource management in MAGIN while meeting queue delay and edge computing constraints.

边缘计算强化学习无人机网络任务卸载

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。