arXiv:2603.15771cs.ROcs.AI2026-03被引 2

让自动驾驶规划器学会自我纠错,提升安全性。

CorrectionPlanner: Self-Correction Planner with Reinforcement Learning in Autonomous Driving

  • 通过提议-评估-修正循环生成动作,自动纠正不安全行为。
  • 在Waymax上碰撞率降低超20%,nuPlan上达到顶尖规划得分。
  • 适合关注自动驾驶安全与可解释性规划的研究者。

自动驾驶需要安全的路径规划,但大多数基于学习的规划器缺乏显式的自我纠正能力:一旦提出不安全动作,就无法修正。为此,我们提出CorrectionPlanner,一种具有自纠正能力的自回归规划器,将规划建模为在提议、评估与修正循环中生成运动标记的过程。每个规划步骤中,策略提出一个动作(即运动标记),由学习到的碰撞判别器预测其在短时视野内是否引发碰撞。若判别器预测有碰撞,则保留历史不安全运动标记序列作为自纠正轨迹,条件化生成下一个运动标记,并重复此过程,直至提出安全动作或满足安全准则。该自纠正轨迹由所有不安全运动标记构成,代表规划器在运动标记空间中的修正过程,类似于语言模型中的推理轨迹。我们采用模仿学习结合基于预训练世界模型的模型式强化学习进行训练,该世界模型能真实模拟其他交通参与者的行为反应。闭环评估显示,CorrectionPlanner在Waymax上碰撞率降低超过20%,并在nuPlan上取得当前最优规划得分。

原文摘要 · Abstract (English)

Autonomous driving requires safe planning, but most learning-based planners lack explicit self-correction ability: once an unsafe action is proposed, there is no mechanism to correct it. Thus, we propose CorrectionPlanner, an autoregressive planner with self-correction that models planning as motion-token generation within a propose, evaluate, and correct loop. At each planning step, the policy proposes an action, namely a motion token, and a learned collision critic predicts whether it will induce a collision within a short horizon. If the critic predicts a collision, we retain the sequence of historical unsafe motion tokens as a self-correction trace, generate the next motion token conditioned on it, and repeat this process until a safe motion token is proposed or the safety criterion is met. This self-correction trace, consisting of all unsafe motion tokens, represents the planner's correction process in motion-token space, analogous to a reasoning trace in language models. We train the planner with imitation learning followed by model-based reinforcement learning using rollouts from a pretrained world model that realistically models agents' reactive behaviors. Closed-loop evaluations show that CorrectionPlanner reduces collision rate by over 20% on Waymax and achieves state-of-the-art planning scores on nuPlan.

自动驾驶自纠正强化学习规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。