基于强化学习的轨迹规划模型,实现高效稳定的大规模自动驾驶路径生成。
CarPlanner: Consistent Auto-regressive Trajectory Planning for Large-scale Reinforcement Learning in Autonomous Driving
- 采用自回归结构与一致性机制,提升训练效率与轨迹连贯性。
- 在nuPlan数据集上超越强化学习、模仿学习及规则类最优方法。
- 适合追求高鲁棒性与可扩展性的自动驾驶系统研发人员。
轨迹规划对自动驾驶至关重要,确保在复杂环境中安全高效导航。尽管基于学习的方法(尤其是强化学习)在特定场景中展现出潜力,但现有强化学习规划器在大规模真实驾驶场景中仍面临训练效率低和性能不足的问题。本文提出 extbf{CarPlanner},一种一致的自回归规划器,利用强化学习生成多模态轨迹。其自回归结构支持高效的规模化强化学习训练,而一致性机制通过保持时间步间的连贯性,实现稳定的策略学习。此外,CarPlanner 采用生成-选择框架,结合专家引导的奖励函数与不变视角模块,简化训练流程并提升策略表现。大量实验表明,该框架有效解决了训练效率与性能提升难题。据我们所知,这是首个在挑战性的真实世界数据集 nuPlan 上,使强化学习规划器超越模仿学习与规则类最先进方法的成果。CarPlanner 在该数据集上全面优于现有的强化学习、模仿学习及规则类最先进方法。
原文摘要 · Abstract (English)
Trajectory planning is vital for autonomous driving, ensuring safe and efficient navigation in complex environments. While recent learning-based methods, particularly reinforcement learning (RL), have shown promise in specific scenarios, RL planners struggle with training inefficiencies and managing large-scale, real-world driving scenarios. In this paper, we introduce \textbf{CarPlanner}, a \textbf{C}onsistent \textbf{a}uto-\textbf{r}egressive \textbf{Planner} that uses RL to generate multi-modal trajectories. The auto-regressive structure enables efficient large-scale RL training, while the incorporation of consistency ensures stable policy learning by maintaining coherent temporal consistency across time steps. Moreover, CarPlanner employs a generation-selection framework with an expert-guided reward function and an invariant-view module, simplifying RL training and enhancing policy performance. Extensive analysis demonstrates that our proposed RL framework effectively addresses the challenges of training efficiency and performance enhancement, positioning CarPlanner as a promising solution for trajectory planning in autonomous driving. To the best of our knowledge, we are the first to demonstrate that the RL-based planner can surpass both IL- and rule-based state-of-the-arts (SOTAs) on the challenging large-scale real-world dataset nuPlan. Our proposed CarPlanner surpasses RL-, IL-, and rule-based SOTA approaches within this demanding dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。