arXiv:2510.10960cs.RO2025-10被引 1

用博弈论建模交通风险,让自动驾驶更安全高效

Game-Theoretic Risk-Shaped Reinforcement Learning for Safe Autonomous Driving

  • 构建多层级博弈模型预测车辆行为与风险
  • 动态调整规划时长,碰撞率降低47%
  • 适合高动态交通场景的自动驾驶系统

确保自动驾驶(AD)中的安全性仍是重大挑战,尤其在高度动态且复杂的交通环境中,各类交互主体频繁出现意外风险。传统强化学习方法往往难以兼顾安全、效率与适应性,因其主要聚焦于奖励最大化,未显式建模风险或安全约束。为此,本文提出一种新型博弈论风险引导强化学习(GTR2L)框架。GTR2L融合多层级博弈论世界模型,联合预测周边车辆的交互行为及其关联风险,并引入自适应展开时域,根据预测不确定性动态调整。同时,设计不确定性感知的屏障机制,实现安全边界的灵活调节。此外,提出专用风险建模方法,显式捕捉认知不确定性(epistemic)与随机不确定性(aleatoric),以指导受限策略优化,在复杂环境中的决策能力显著增强。在多样且安全关键的交通场景中广泛评估表明,GTR2L在成功率、碰撞与违规减少率及驾驶效率方面均显著优于现有先进基线,包括人类驾驶员。代码已公开于 https://github.com/DanielHu197/GTR2L。

原文摘要 · Abstract (English)

Ensuring safety in autonomous driving (AD) remains a significant challenge, especially in highly dynamic and complex traffic environments where diverse agents interact and unexpected hazards frequently emerge. Traditional reinforcement learning (RL) methods often struggle to balance safety, efficiency, and adaptability, as they primarily focus on reward maximization without explicitly modeling risk or safety constraints. To address these limitations, this study proposes a novel game-theoretic risk-shaped RL (GTR2L) framework for safe AD. GTR2L incorporates a multi-level game-theoretic world model that jointly predicts the interactive behaviors of surrounding vehicles and their associated risks, along with an adaptive rollout horizon that adjusts dynamically based on predictive uncertainty. Furthermore, an uncertainty-aware barrier mechanism enables flexible modulation of safety boundaries. A dedicated risk modeling approach is also proposed, explicitly capturing both epistemic and aleatoric uncertainty to guide constrained policy optimization and enhance decision-making in complex environments. Extensive evaluations across diverse and safety-critical traffic scenarios show that GTR2L significantly outperforms state-of-the-art baselines, including human drivers, in terms of success rate, collision and violation reduction, and driving efficiency. The code is available at https://github.com/DanielHu197/GTR2L.

自动驾驶强化学习风险建模博弈论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。