arXiv:2410.08854cs.LGcs.AI2024-10中稿 · IEEE Wireless Comm…被引 2

用大模型+强化学习联合优化车路通信与自动驾驶,提升安全与效率

Hybrid LLM-DDQN based Joint Optimization of V2I Communication and Autonomous Driving

  • 融合大模型与双深度Q网络,分层优化驾驶决策与通信策略
  • 迭代优化使系统收敛更快,平均奖励提升显著
  • 适合关注智能交通与多智能体协同的科研与工程人员

大型语言模型(LLMs)因其卓越的推理与理解能力受到广泛关注。本文探索将LLMs应用于车载网络,旨在联合优化车对基础设施(V2I)通信与自动驾驶(AD)策略。采用LLMs进行自动驾驶决策,以最大化交通流并避免碰撞,保障道路安全;同时使用双深度Q学习算法(DDQN)优化V2I通信,以最大化接收数据速率并减少频繁切换。针对基于LLM的自动驾驶,我们利用欧氏距离识别已探索的驾驶经验,使模型从过往优劣决策中学习,持续改进。随后,将LLM生成的自动驾驶决策作为状态输入至V2I问题中,由DDQN相应优化通信策略。二者通过迭代方式联合优化直至收敛。该方法有效揭示了大模型与传统强化学习技术间的交互潜力,展现出在网路优化与管理中的应用前景。仿真结果表明,所提混合式LLM-DDQN方法优于传统DDQN,在收敛速度与平均奖励方面均有显著提升。

原文摘要 · Abstract (English)

Large language models (LLMs) have received considerable interest recently due to their outstanding reasoning and comprehension capabilities. This work explores applying LLMs to vehicular networks, aiming to jointly optimize vehicle-to-infrastructure (V2I) communications and autonomous driving (AD) policies. We deploy LLMs for AD decision-making to maximize traffic flow and avoid collisions for road safety, and a double deep Q-learning algorithm (DDQN) is used for V2I optimization to maximize the received data rate and reduce frequent handovers. In particular, for LLM-enabled AD, we employ the Euclidean distance to identify previously explored AD experiences, and then LLMs can learn from past good and bad decisions for further improvement. Then, LLM-based AD decisions will become part of states in V2I problems, and DDQN will optimize the V2I decisions accordingly. After that, the AD and V2I decisions are iteratively optimized until convergence. Such an iterative optimization approach can better explore the interactions between LLMs and conventional reinforcement learning techniques, revealing the potential of using LLMs for network optimization and management. Finally, the simulations demonstrate that our proposed hybrid LLM-DDQN approach outperforms the conventional DDQN algorithm, showing faster convergence and higher average rewards.

自动驾驶车路协同强化学习大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。