arXiv:2409.05712cs.RO2024-09被引 49

让自动驾驶汽车在无信号交叉口协作通行,更安全高效。

Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors

  • 用注意力机制捕捉车辆间交互关系,指导决策。
  • 引入分层博弈先验,提升行驶安全性和效率。
  • 适合研究智能交通协同决策的学者与工程师。

自动驾驶车辆的发展为提升交通系统效率与安全性带来巨大潜力,但在人机混合交通场景(如无信号交叉口)中的决策问题仍是挑战。尽管强化学习(RL)可用于解决复杂决策问题,现有方法在多辆联网自动驾驶汽车(CAVs)的协作决策、探索过程中的安全性保障以及真实人类驾驶行为模拟方面仍存在局限。本文提出一种新型高效算法——多智能体博弈先验注意力深度确定性策略梯度(MA-GA-DDPG),将无信号交叉口处CAVs的决策问题建模为去中心化的多智能体强化学习问题,并引入注意力机制以捕捉主车与其它车辆间的交互依赖。通过注意力权重筛选交互对象并获取分层博弈先验关系,进而设计安全检查模块以提升交通安全性。仿真与软硬件在环实验表明,该方法在驾驶安全性、效率和舒适性方面均优于其他基线方法。

原文摘要 · Abstract (English)

The development of autonomous vehicles has shown great potential to enhance the efficiency and safety of transportation systems. However, the decision-making issue in complex human-machine mixed traffic scenarios, such as unsignalized intersections, remains a challenge for autonomous vehicles. While reinforcement learning (RL) has been used to solve complex decision-making problems, existing RL methods still have limitations in dealing with cooperative decision-making of multiple connected autonomous vehicles (CAVs), ensuring safety during exploration, and simulating realistic human driver behaviors. In this paper, a novel and efficient algorithm, Multi-Agent Game-prior Attention Deep Deterministic Policy Gradient (MA-GA-DDPG), is proposed to address these limitations. Our proposed algorithm formulates the decision-making problem of CAVs at unsignalized intersections as a decentralized multi-agent reinforcement learning problem and incorporates an attention mechanism to capture interaction dependencies between ego CAV and other agents. The attention weights between the ego vehicle and other agents are then used to screen interaction objects and obtain prior hierarchical game relations, based on which a safety inspector module is designed to improve the traffic safety. Furthermore, both simulation and hardware-in-the-loop experiments were conducted, demonstrating that our method outperforms other baseline approaches in terms of driving safety, efficiency, and comfort.

自动驾驶多智能体强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。