arXiv:2411.15139cs.CVcs.RO2024-11CVPR被引 368

提出一种截断扩散模型,实现自动驾驶实时多样决策。

DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving

论文配图:DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving
图 1 · 摘自论文原文
  • 用预设多模态锚点截断扩散过程,加速推理
  • 仅2步生成,较原模型减少10倍推理步骤
  • 适合追求实时性与驾驶多样性场景的开发者

最近,扩散模型作为机器人策略学习的强大生成技术,能够建模多模式动作分布。将其应用于端到端自动驾驶具有广阔前景。然而,机器人扩散策略中的大量去噪步骤,以及交通场景动态开放的特点,给实时生成多样化驾驶动作带来挑战。为此,本文提出一种新型截断扩散策略DiffusionDrive,引入先验多模态锚点并截断扩散时序,使模型从锚定高斯分布高效学习到多模式驾驶动作分布。同时设计高效级联扩散解码器以增强对条件场景上下文的交互。实验表明,相比原扩散策略,DiffusionDrive在推理步骤上减少10倍,仅需2步即可生成高质量且多样化的驾驶动作。在面向规划的NAVSIM数据集上,采用对齐的ResNet-34主干网络,取得88.1 PDMS性能,未加额外优化即创纪录,且在NVIDIA 4090上达到45 FPS的实时速度。复杂场景下的定性结果进一步验证了其生成鲁棒、合理驾驶动作的能力。代码与模型将开源于https://github.com/hustvl/DiffusionDrive。

原文摘要 · Abstract (English)

Recently, the diffusion model has emerged as a powerful generative technique for robotic policy learning, capable of modeling multi-mode action distributions. Leveraging its capability for end-to-end autonomous driving is a promising direction. However, the numerous denoising steps in the robotic diffusion policy and the more dynamic, open-world nature of traffic scenes pose substantial challenges for generating diverse driving actions at a real-time speed. To address these challenges, we propose a novel truncated diffusion policy that incorporates prior multi-mode anchors and truncates the diffusion schedule, enabling the model to learn denoising from anchored Gaussian distribution to the multi-mode driving action distribution. Additionally, we design an efficient cascade diffusion decoder for enhanced interaction with conditional scene context. The proposed model, DiffusionDrive, demonstrates 10$\times$ reduction in denoising steps compared to vanilla diffusion policy, delivering superior diversity and quality in just 2 steps. On the planning-oriented NAVSIM dataset, with the aligned ResNet-34 backbone, DiffusionDrive achieves 88.1 PDMS without bells and whistles, setting a new record, while running at a real-time speed of 45 FPS on an NVIDIA 4090. Qualitative results on challenging scenarios further confirm that DiffusionDrive can robustly generate diverse plausible driving actions. Code and model will be available at https://github.com/hustvl/DiffusionDrive.

自动驾驶扩散模型实时生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。