arXiv:2503.19690cs.RO2025-03被引 5

让自动驾驶在无信号灯路口更安全,通过风险感知提升决策可靠性。

Risk-Aware Reinforcement Learning for Autonomous Driving: Improving Safety When Driving through Intersection

  • 引入安全评价器与奖励评价器协同优化策略,实时评估驾驶风险。
  • 碰撞率显著降低,通行效率优于传统强化学习方法。
  • 适合关注自动驾驶安全与动态交通适应性的研究者。

将强化学习应用于自动驾驶已受到广泛关注。然而,传统强化学习方法仅以最大化期望回报为目标,缺乏足够的安全性考量,常使智能体陷入危险情境。本文提出一种面向自动驾驶的風險感知强化学习方法,以提升通过无信号灯路口时的安全性。通过构建安全评价器,与奖励评价器协同更新策略网络;结合拉格朗日松弛与循环梯度迭代,将动作投影至安全可行区域。同时,在演员-评论家网络中引入多跳多层感知混合注意力机制(MMAM),使策略能自适应动态交通环境,并克服排列敏感性问题,更有效聚焦于周围潜在风险,提升对通行时机的识别能力。在多个无信号灯路口任务上的仿真测试表明,该方法显著降低了碰撞率,提升了通行效率。消融实验进一步验证了风险感知与MMAM的有效性。

原文摘要 · Abstract (English)

Applying reinforcement learning to autonomous driving has garnered widespread attention. However, classical reinforcement learning methods optimize policies by maximizing expected rewards but lack sufficient safety considerations, often putting agents in hazardous situations. This paper proposes a risk-aware reinforcement learning approach for autonomous driving to improve the safety performance when crossing the intersection. Safe critics are constructed to evaluate driving risk and work in conjunction with the reward critic to update the actor. Based on this, a Lagrangian relaxation method and cyclic gradient iteration are combined to project actions into a feasible safe region. Furthermore, a Multi-hop and Multi-layer perception (MLP) mixed Attention Mechanism (MMAM) is incorporated into the actor-critic network, enabling the policy to adapt to dynamic traffic and overcome permutation sensitivity challenges. This allows the policy to focus more effectively on surrounding potential risks while enhancing the identification of passing opportunities. Simulation tests are conducted on different tasks at unsignalized intersections. The results show that the proposed approach effectively reduces collision rates and improves crossing efficiency in comparison to baseline algorithms. Additionally, our ablation experiments demonstrate the benefits of incorporating risk-awareness and MMAM into RL.

自动驾驶强化学习安全决策注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。