用离散扩散模型实现自动驾驶安全轨迹生成,无需梯度计算。
Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Driving
- 将二维驾驶空间离散化构建动作码本,用预训练扩散语言模型微调规划。
- 通过迭代自纠错机制,识别不安全动作并重构轨迹,提升安全性。
- 适合追求高安全性的端到端自动驾驶系统,尤其在复杂场景中表现优异。
端到端(E2E)自动驾驶系统已成为主流,视觉-语言-动作(VLA)模型利用预训练的视觉-语言模型(VLM)知识来理解并交互于复杂真实环境。然而,这些方法受限于模仿学习的不足,难以在训练中内化物理规则。现有方法多依赖复杂的规则后处理、局限于模拟环境的强化学习,或需要昂贵梯度计算的扩散引导。为此,我们提出ReflectDrive,一种基于反射机制的安全轨迹生成新框架,采用离散扩散技术。首先将二维驾驶空间离散化,构建动作码本,通过微调预训练扩散语言模型完成规划任务。核心是无需梯度计算的安全感知反射机制,进行迭代自纠正。从目标条件轨迹生成开始,建模多模态驾驶行为;再使用局部搜索识别不安全令牌,确定可行解作为安全锚点,进行基于插值的轨迹重生成。在NAVSIM基准测试中,ReflectDrive在安全关键轨迹生成上表现出显著优势,为自动驾驶系统提供可扩展、可靠的解决方案。
原文摘要 · Abstract (English)
End-to-End (E2E) solutions have emerged as a mainstream approach for autonomous driving systems, with Vision-Language-Action (VLA) models representing a new paradigm that leverages pre-trained multimodal knowledge from Vision-Language Models (VLMs) to interpret and interact with complex real-world environments. However, these methods remain constrained by the limitations of imitation learning, which struggles to inherently encode physical rules during training. Existing approaches often rely on complex rule-based post-refinement, employ reinforcement learning that remains largely limited to simulation, or utilize diffusion guidance that requires computationally expensive gradient calculations. To address these challenges, we introduce ReflectDrive, a novel learning-based framework that integrates a reflection mechanism for safe trajectory generation via discrete diffusion. We first discretize the two-dimensional driving space to construct an action codebook, enabling the use of pre-trained Diffusion Language Models for planning tasks through fine-tuning. Central to our approach is a safety-aware reflection mechanism that performs iterative self-correction without gradient computation. Our method begins with goal-conditioned trajectory generation to model multi-modal driving behaviors. Based on this, we apply local search methods to identify unsafe tokens and determine feasible solutions, which then serve as safe anchors for inpainting-based regeneration. Evaluated on the NAVSIM benchmark, ReflectDrive demonstrates significant advantages in safety-critical trajectory generation, offering a scalable and reliable solution for autonomous driving systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。