arXiv:2503.19418cs.LG2025-03

用智能表面辅助的多智能体强化学习,提升自动驾驶车联网的通信安全与效率。

Multi-Agent Deep Reinforcement Learning for Safe Autonomous Driving with RICS-Assisted MEC

  • 设计多智能体强化学习框架,协同优化车辆间通信与感知
  • 在动态信道下实现更快收敛,数据速率提升且驾驶更安全
  • 适合关注智能交通、边缘计算与强化学习融合的研究者

未来自动驾驶网络中,车载传感器环境感知与融合技术将广泛应用。本文研究一种由多辆自动驾驶汽车组成的车联网系统,该系统借助多接入边缘计算(MEC)进行数据处理,通过车对基础设施(V2I)链路将传感器图像数据上传至边缘服务器,并利用车对车(V2V)通信共享感知信息。为提高频谱利用率,V2V链路可复用与V2I相同的频谱,但会引发严重干扰。为此,本文引入可重构智能计算表面(RICS),联合实现V2I反射链路并抑制V2V链路的干扰。针对传统算法在时变信道下因依赖准静态信道状态信息而难以适应动态环境的问题,本文将问题建模为马尔可夫博弈,引入用户间协作学习机制。采用驱动安全增强的多智能体深度强化学习(DS-MADRL)方法求解,充分利用了RICS特性。大量数值实验表明,所提方法相比多种先进基准,在收敛速度、数据速率和驾驶安全性方面均有显著提升。

原文摘要 · Abstract (English)

Environment sensing and fusion via onboard sensors are envisioned to be widely applied in future autonomous driving networks. This paper considers a vehicular system with multiple self-driving vehicles that is assisted by multi-access edge computing (MEC), where image data collected by the sensors is offloaded from cellular vehicles to the MEC server using vehicle-to-infrastructure (V2I) links. Sensory data can also be shared among surrounding vehicles via vehicle-to-vehicle (V2V) communication links. To improve spectrum utilization, the V2V links may reuse the same frequency spectrum with V2I links, which may cause severe interference. To tackle this issue, we leverage reconfigurable intelligent computational surfaces (RICSs) to jointly enable V2I reflective links and mitigate interference appearing at the V2V links. Considering the limitations of traditional algorithms in addressing this problem, such as the assumption for quasi-static channel state information, which restricts their ability to adapt to dynamic environmental changes and leads to poor performance under frequently varying channel conditions, in this paper, we formulate the problem at hand as a Markov game. Our novel formulation is applied to time-varying channels subject to multi-user interference and introduces a collaborative learning mechanism among users. The considered optimization problem is solved via a driving safety-enabled multi-agent deep reinforcement learning (DS-MADRL) approach that capitalizes on the RICS presence. Our extensive numerical investigations showcase that the proposed reinforcement learning approach achieves faster convergence and significant enhancements in both data rate and driving safety, as compared to various state-of-the-art benchmarks.

自动驾驶强化学习边缘计算智能表面

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。